00000001:02000400:0.0F:1787387547.959407:0:2966:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787387567.120064:0:3188:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1787387569.155489:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 947 MB/s 00000001:01000000:0.0:1787387569.404956:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1423 MB/s 00000001:01000000:3.0F:1787387569.654782:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7347 MB/s 00000020:02000000:0.0:1787387570.380240:0:3280:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_111_ga5eb910 00000400:02000000:1.0:1787387571.159380:0:3295:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.159@tcp [8/256/0/180] 00008000:02000000:2.0F:1787387574.759346:0:3445:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787387630.799594:0:5253:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787387640.044661:0:5788:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787387640.044666:0:5788:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787387640.044886:0:5788:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000058134b71 00000080:02000400:0.0:1787387640.044896:0:5788:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787387640.060021:0:5788:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787387640.060034:0:5788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787387640.060072:0:5788:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000077b09e6f) 00000020:00000080:0.0:1787387640.060093:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787387640.081676:0:5788:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787387640.082248:0:5788:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787387640.124334:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787387640.125550:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787387640.125597:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787387640.125655:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787387640.125683:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787387640.126904:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787387640.126913:0:5788:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787387640.126925:0:5788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c730a 00000020:01000004:0.0:1787387640.126932:0:5788:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787387640.126936:0:5788:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787387640.126941:0:5788:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000058134b71 from MGS 00000020:01000004:0.0:1787387640.126945:0:5788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787387640.126955:0:5788:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009488a4d6) 00000020:00000080:0.0:1787387640.126965:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787387640.127143:0:5788:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000058134b71 from MGS, refs=2 00080000:01000000:0.0:1787387640.127149:0:5788:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787387640.127155:0:5788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c7318 00000100:00100000:0.0:1787387640.127269:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787387640.127413:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787387640.127426:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787387640.133323:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787387640.133339:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787387640.134665:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387640.134935:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787387640.134940:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787387640.136484:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787387640.136497:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787387640.136919:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787387640.136925:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787387640.146289:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387640.146295:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387640.146297:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387640.146640:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387640.146642:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387640.146644:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387640.147529:0:5788:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787387640.154875:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787387640.396890:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3039 MB/s 00000001:01000000:3.0:1787387640.647820:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3247 MB/s 00000001:01000000:0.0:1787387640.901732:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 466 MB/s 00000001:01000000:3.0:1787387641.152367:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 591 MB/s 00080000:10000000:3.0:1787387641.164512:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1787387641.186167:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787387641.194478:0:5788:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787387641.194494:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787387641.194496:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787387641.199399:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787387641.199479:0:5788:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787387641.199539:0:5788:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787387641.199818:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787387641.199845:0:5788:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787387641.200205:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387641.200337:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787387641.200343:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787387641.206024:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787387641.206039:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787387641.206658:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787387641.206665:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787387641.208108:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787387641.208130:0:5788:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.159@tcp' 00000020:01000004:3.0:1787387641.208132:0:5788:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787387641.208183:0:5788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.159@tcp (typ=mgc) 00000020:00000080:3.0:1787387641.208212:0:5788:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.159@tcp (00000000217ae698) 00000020:00000080:3.0:1787387641.208230:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:1.0:1787387641.208320:0:5803:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:3.0:1787387641.208348:0:5788:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006ef6899e@MGC192.168.204.159@tcp: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1787387641.208512:0:5788:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.159@tcp-0 is initialized 00000040:01000000:3.0:1787387641.208517:0:5788:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787387641.212777:0:5804:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787387641.212846:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.159@tcp (uuid 2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a) 00000020:00000080:2.0:1787387641.212871:0:5788:0:(genops.c:1406:class_connect()) connect: client 2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a, cookie 0x93d41aeaa23c7326 00000100:00080000:2.0:1787387641.212882:0:5788:0:(import.c:510:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387641.212888:0:5788:0:(import.c:624:import_select_connection()) MGC192.168.204.159@tcp: import 000000006ef6899e using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1787387641.212932:0:5788:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a8485c5b x1874211709649024/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387641.212959:0:5788:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a->MGS 00000020:01000004:2.0:1787387641.212989:0:5788:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787387641.212995:0:5788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787387641.213019:0:5788:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a5580269) 00000020:00000080:2.0:1787387641.213034:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787387641.213106:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a8485c5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3310:1874211709649024:0@lo:250: 00000100:00100000:1.0:1787387641.213192:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387641.214787:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709649024 00000100:00100000:3.0:1787387641.214799:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709649024 00000100:00100000:3.0:1787387641.214832:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387641.214838:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afd06bb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874211709649024:12345-0@lo:250: 00010000:00080000:3.0:1787387641.214861:0:5800:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:3.0:1787387641.214893:0:5800:0:(genops.c:1406:class_connect()) connect: client 2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a, cookie 0x93d41aeaa23c7334 00000100:00080000:3.0:1787387641.215014:0:5800:0:(import.c:65:import_set_state_nolock()) 00000000ed9f4009 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787387641.215101:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afd06bb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:3310:x1874211709649024:12345-0@lo:250: Request processed in 262us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387641.215110:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387641.215160:0:3310:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787387641.215168:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.159@tcp: connect to target with instance 0 00000100:00080000:3.0:1787387641.215175:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787387641.215180:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787387641.215183:0:3310:0:(import.c:65:import_set_state_nolock()) 000000006ef6899e MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787387641.215185:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787387641.215415:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787387641.215422:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a8485c5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3310:1874211709649024:0@lo:250: 00000100:00100000:2.0:1787387641.233551:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387641.234778:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787387641.234786:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787387641.236510:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787387641.236528:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787387641.239913:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787387641.239935:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787387641.243816:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387641.244438:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787387641.244445:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787387641.251308:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787387641.251324:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787387641.293561:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387641.294042:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787387641.294049:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787387641.295686:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787387641.295698:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787387641.296339:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387641.296502:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787387641.296507:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787387641.297122:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787387641.297133:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787387641.297727:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387641.297883:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787387641.297888:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787387641.299336:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787387641.299347:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787387641.300203:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387641.300349:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787387641.300353:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787387641.301178:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787387641.301184:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787387641.345494:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787387641.345805:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787387641.345812:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787387641.353359:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787387641.353374:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787387641.355092:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787387641.355104:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787387641.355806:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787387641.355836:0:5788:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787387641.355843:0:5788:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787387641.355983:0:5788:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787387641.356017:0:5788:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787387641.356022:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787387641.356024:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787387641.356025:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387641.356026:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387641.356027:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387641.356028:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387641.356030:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787387641.356031:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787387641.356032:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387641.356033:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387641.356035:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387641.356036:0:5788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787387641.356038:0:5788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787387641.356040:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787387641.356041:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787387641.356042:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387641.356043:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387641.356044:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387641.356045:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387641.356046:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787387641.356047:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787387641.356048:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387641.356054:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387641.356055:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387641.356055:0:5788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787387641.356086:0:5788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787387641.356101:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649152:0@lo:253: 00000100:00100000:2.0:1787387641.356792:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387641.356842:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 0000000089a8ec46 going to sleep for 11 seconds 00000100:00100000:1.0:1787387641.357241:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709649152 00000100:00100000:1.0:1787387641.357250:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709649152 00000100:00100000:1.0:1787387641.357312:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387641.357318:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b920b7ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:5788:x1874211709649152:12345-0@lo:253: 20000000:01000000:1.0:1787387641.357358:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787387641.357361:0:5802:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787387641.359073:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787387641.359166:0:5802:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787387641.359455:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387641.360299:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787387641.363375:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787387641.363382:0:5802:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787387641.363388:0:5802:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787387641.363391:0:5802:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787387641.363404:0:5802:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787387641.364795:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787387641.365090:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787387641.365109:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787387641.365158:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787387641.365203:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787387641.365239:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787387641.365341:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787387641.365349:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787387641.365397:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787387641.365406:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787387641.365453:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787387641.365461:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787387641.365492:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787387641.365540:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787387641.365574:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787387641.365579:0:5802:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787387641.365592:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787387641.367356:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787387641.367382:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787387641.367436:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787387641.367467:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787387641.367509:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787387641.367524:0:5802:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787387641.367614:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787387641.367624:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787387641.367671:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787387641.367706:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787387641.367770:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787387641.367784:0:5802:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787387641.367864:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787387641.367873:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787387641.367906:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787387641.367940:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787387641.368142:0:5802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787387641.368191:0:5802:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787387641.368199:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787387641.370397:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787387641.370860:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787387641.370886:0:5802:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.159@tcp for mdt 20000000:01000000:3.0:1787387641.370888:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:3.0:1787387641.370923:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787387641.370931:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787387641.371097:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787387641.371107:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:3.0:1787387641.371339:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787387641.371350:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787387641.371383:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787387641.371416:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787387641.371481:0:5802:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787387641.371484:0:5802:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787387641.371490:0:5802:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787387641.371497:0:5802:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787387641.376952:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1787387641.377076:0:5802:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787387641.392823:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787387641.392913:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1787387641.393010:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1787387641.393031:0:5802:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787387641.393034:0:5802:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787387641.393039:0:5802:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787387641.393066:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787387641.393069:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787387641.393099:0:5802:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787387641.393102:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787387641.394472:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787387641.398999:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787387641.399059:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787387641.399094:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787387641.399109:0:5802:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787387641.399121:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787387641.402348:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1787387641.414225:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1787387641.414270:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1787387641.414333:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1787387641.414352:0:5802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787387641.414355:0:5802:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1787387641.414362:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787387641.414384:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000013742054/0x93d41aeaa23c733b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.414400:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013742054/0x93d41aeaa23c733b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.414410:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000013742054/0x93d41aeaa23c733b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.414416:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000013742054/0x93d41aeaa23c733b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.414434:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000013742054/0x93d41aeaa23c733b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.414441:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000013742054/0x93d41aeaa23c733b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.414446:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000013742054 already unused, calling callback (000000005b070e73) 00010000:00010000:2.0:1787387641.414450:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000013742054/0x93d41aeaa23c733b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.414456:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000013742054/0x93d41aeaa23c733b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.414467:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000013742054/0x93d41aeaa23c733b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.414474:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000013742054/0x93d41aeaa23c733b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.414479:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000013742054/0x93d41aeaa23c733b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787387641.414494:0:5802:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787387641.662310:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b920b7ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:5788:x1874211709649152:12345-0@lo:253: Request processed in 304985us (305514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387641.662329:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787387641.662561:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649152:0@lo:253: 10000000:01000000:2.0:1787387641.662575:0:5788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787387641.662578:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787387641.662580:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787387641.662581:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387641.662582:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787387641.662583:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387641.662599:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387641.662601:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787387641.662602:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787387641.662603:0:5788:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787387641.662605:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387641.662606:0:5788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787387641.662672:0:5788:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000058134b71 from lustre-MDT0000 10000000:01000000:2.0:1787387641.662702:0:5788:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787387641.662705:0:5788:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787387641.662710:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d43434a99c0 10000000:01000000:2.0:1787387641.662714:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787387641.662721:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d43434a99c0 from 1 10000000:01000000:2.0:1787387641.662724:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787387641.662776:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 0000000013742054/0x93d41aeaa23c7342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.662787:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 0000000013742054/0x93d41aeaa23c7342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.662798:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 0000000013742054/0x93d41aeaa23c7342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387641.662815:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649280:0@lo:101: 00000100:00100000:2.0:1787387641.662857:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387641.662909:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709649280 00000100:00100000:3.0:1787387641.662916:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709649280 00000100:00100000:2.0:1787387641.662927:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da36db17 going to sleep for 11 seconds 00000100:00100000:3.0:1787387641.662953:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387641.662961:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c677c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:5788:x1874211709649280:12345-0@lo:101: 00010000:00010000:3.0:1787387641.662985:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387641.663000:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a8846b43/0x93d41aeaa23c7349 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7342 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387641.663036:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8846b43/0x93d41aeaa23c7349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7342 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387641.663046:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a8846b43/0x93d41aeaa23c7349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7342 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387641.663055:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a8846b43, rc 0) 00000100:00100000:3.0:1787387641.663095:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c677c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+6:5788:x1874211709649280:12345-0@lo:101: Request processed in 135us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387641.663101:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387641.663637:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649280:0@lo:101: 00010000:00010000:2.0:1787387641.663652:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 0000000013742054/0x93d41aeaa23c7342 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.663660:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 0000000013742054/0x93d41aeaa23c7342 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387641.663730:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649408:0@lo:501: 00000100:00100000:2.0:1787387641.663793:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387641.663824:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da36db17 going to sleep for 11 seconds 00000100:00100000:0.0:1787387641.663895:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709649408 00000100:00100000:0.0:1787387641.663901:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709649408 00000100:00100000:0.0:1787387641.663945:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387641.663951:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a56197e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+6:5788:x1874211709649408:12345-0@lo:501: 00000100:00100000:0.0:1787387641.664196:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a56197e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+6:5788:x1874211709649408:12345-0@lo:501: Request processed in 244us (402us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787387641.664203:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387641.664528:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649408:0@lo:501: 10000000:01000000:2.0:1787387641.664556:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787387641.664574:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 0000000013742054/0x93d41aeaa23c7342 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.664582:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 0000000013742054/0x93d41aeaa23c7342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387641.664590:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d4350ce4000 10000000:01000000:2.0:1787387641.664594:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787387641.664598:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d4350ce4000 10000000:01000000:2.0:1787387641.664600:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787387641.664602:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8d4350ce4000 from 1 10000000:01000000:2.0:1787387641.664604:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787387641.664624:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000716701f6/0x93d41aeaa23c7350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.664630:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000716701f6/0x93d41aeaa23c7350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.664638:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000716701f6/0x93d41aeaa23c7350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387641.664650:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649536:0@lo:101: 00000100:00100000:2.0:1787387641.664689:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387641.664712:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da36db17 going to sleep for 11 seconds 00000100:00100000:3.0:1787387641.664774:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709649536 00000100:00100000:3.0:1787387641.664780:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709649536 00000100:00100000:3.0:1787387641.664824:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387641.664831:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7485f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+6:5788:x1874211709649536:12345-0@lo:101: 00010000:00010000:3.0:1787387641.664839:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387641.664850:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4fc83c0/0x93d41aeaa23c7357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7350 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387641.664868:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4fc83c0/0x93d41aeaa23c7357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7350 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387641.664877:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4fc83c0/0x93d41aeaa23c7357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7350 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387641.664884:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4fc83c0, rc 0) 00000100:00100000:3.0:1787387641.664922:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7485f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+7:5788:x1874211709649536:12345-0@lo:101: Request processed in 92us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387641.664927:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387641.665115:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649536:0@lo:101: 00010000:00010000:2.0:1787387641.665125:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000716701f6/0x93d41aeaa23c7350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.665132:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000716701f6/0x93d41aeaa23c7350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387641.665143:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787387641.665156:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000716701f6/0x93d41aeaa23c7350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.665162:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000716701f6/0x93d41aeaa23c7350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387641.665168:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787387641.665171:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787387641.665175:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d4350ce4000 10000000:01000000:2.0:1787387641.665178:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787387641.665181:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787387641.665183:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787387641.665195:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000f39e29b2/0x93d41aeaa23c735e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.665202:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000f39e29b2/0x93d41aeaa23c735e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.665208:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000f39e29b2/0x93d41aeaa23c735e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387641.665225:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649664:0@lo:101: 00000100:00100000:2.0:1787387641.665249:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387641.665274:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da36db17 going to sleep for 11 seconds 00000100:00100000:1.0:1787387641.665387:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709649664 00000100:00100000:1.0:1787387641.665393:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709649664 00000100:00100000:1.0:1787387641.665421:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787387641.665426:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e266d373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+7:5788:x1874211709649664:12345-0@lo:101: 00010000:00010000:1.0:1787387641.665433:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387641.665441:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9566259/0x93d41aeaa23c7365 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c735e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387641.665455:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9566259/0x93d41aeaa23c7365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c735e expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387641.665462:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9566259/0x93d41aeaa23c7365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c735e expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387641.665467:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9566259, rc 0) 00000100:00100000:1.0:1787387641.665501:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e266d373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+8:5788:x1874211709649664:12345-0@lo:101: Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387641.665507:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787387641.665526:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649664:0@lo:101: 00010000:00010000:2.0:1787387641.665535:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000f39e29b2/0x93d41aeaa23c735e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387641.665542:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000f39e29b2/0x93d41aeaa23c735e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387641.665580:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649792:0@lo:501: 00000100:00100000:2.0:1787387641.665605:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387641.665634:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da36db17 going to sleep for 11 seconds 00000100:00100000:0.0:1787387641.665728:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709649792 00000100:00100000:0.0:1787387641.665733:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709649792 00000100:00100000:0.0:1787387641.665780:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387641.665789:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066b1bee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+8:5788:x1874211709649792:12345-0@lo:501: 00000100:00100000:0.0:1787387641.666242:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066b1bee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:5788:x1874211709649792:12345-0@lo:501: Request processed in 456us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387641.666251:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787387641.666389:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649792:0@lo:501: 00000100:00100000:2.0:1787387641.666419:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649920:0@lo:503: 00000100:00100000:2.0:1787387641.666456:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387641.666526:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da36db17 going to sleep for 11 seconds 00000100:00100000:3.0:1787387641.666565:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709649920 00000100:00100000:3.0:1787387641.666570:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709649920 00000100:00100000:3.0:1787387641.666645:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387641.666652:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034b43668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:5788:x1874211709649920:12345-0@lo:503: 00000100:00100000:3.0:1787387641.666849:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034b43668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:5788:x1874211709649920:12345-0@lo:503: Request processed in 198us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387641.666855:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787387641.666923:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709649920:0@lo:503: 00000100:00100000:0.0:1787387641.667562:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5830:1874211709650048:0@lo:502: 00000100:00100000:0.0:1787387641.667604:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387641.667644:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003165069 going to sleep for 11 seconds 00000100:00100000:3.0:1787387641.667703:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709650048 00000100:00100000:3.0:1787387641.667709:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709650048 00000100:00100000:3.0:1787387641.667766:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387641.667772:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030b461bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:5830:x1874211709650048:12345-0@lo:502: 00000100:00100000:3.0:1787387641.667954:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030b461bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:5830:x1874211709650048:12345-0@lo:502: Request processed in 182us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387641.667961:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787387641.667996:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5830:1874211709650048:0@lo:502: 00000020:01000000:0.0:1787387641.668019:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387641.668030:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387641.668032:0:5830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787387641.668038:0:5830:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787387641.668041:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787387641.668053:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000a7d16520) 00000020:00000080:0.0:1787387641.668071:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787387641.668077:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787387641.668139:0:5830:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787387641.668146:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c7373 00000020:00000080:0.0:1787387641.668357:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787387641.668362:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387641.668365:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387641.668366:0:5830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787387641.668369:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387641.668372:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387641.668373:0:5830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787387641.668376:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787387641.668382:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007efaec89) 00000020:00000080:0.0:1787387641.668390:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787387641.668394:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787387641.668396:0:5830:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787387641.668398:0:5830:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787387641.668403:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787387641.668441:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000058134b71 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787387641.668459:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007d7dd55e) 00000020:00000080:0.0:1787387641.668470:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787387641.668531:0:5830:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787387641.668537:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x93d41aeaa23c7388 00000020:00000080:0.0:1787387641.669458:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787387641.669469:0:5830:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787387641.669486:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x93d41aeaa23c738f 00080000:01000000:0.0:1787387641.669494:0:5830:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787387641.669498:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c7396 00080000:10000000:0.0:1787387641.670108:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787387641.670304:0:5830:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787387641.678413:0:5830:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787387641.749227:0:5830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787387641.749593:0:5830:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787387641.757652:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787387641.758016:0:5830:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787387641.823448:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000007ab1d2c0) 00000020:00000080:2.0:1787387641.823472:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787387641.823532:0:5830:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787387641.823544:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c73a4 00000020:00000080:2.0:1787387641.827756:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787387641.831760:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787387641.884140:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787387641.928126:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787387641.967562:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787387642.012544:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787387642.108482:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787387642.183178:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x93d41aeaa23c73ab 00000020:00000080:1.0:1787387642.183592:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787387642.183604:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387642.183610:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387642.183612:0:5830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787387642.183615:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387642.183620:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387642.183622:0:5830:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787387642.183626:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787387642.183659:0:5830:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787387642.183673:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387642.183681:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387642.183683:0:5830:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787387642.183685:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387642.183688:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387642.183689:0:5830:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787387642.183692:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787387642.183693:0:5830:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787387642.183776:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000726f5c10 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5830:1874211709650176:0@lo:502: 00000100:00100000:1.0:1787387642.183854:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387642.184115:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set 000000004cfb5065 going to sleep for 11 seconds 00000100:00100000:0.0:1787387642.184262:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709650176 00000100:00100000:0.0:1787387642.184269:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709650176 00000100:00100000:0.0:1787387642.184320:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787387642.184328:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063befa72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:5830:x1874211709650176:12345-0@lo:502: 00000100:00100000:0.0:1787387642.184636:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063befa72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:5830:x1874211709650176:12345-0@lo:502: Request processed in 308us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387642.184645:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387642.184799:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000726f5c10 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5830:1874211709650176:0@lo:502: 00000020:01000000:2.0:1787387642.184828:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387642.184833:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387642.184834:0:5830:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787387642.184838:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787387642.185224:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787387642.185245:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787387642.185265:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000f39e29b2/0x93d41aeaa23c735e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.185275:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000f39e29b2/0x93d41aeaa23c735e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387642.185283:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4350ce4000 from 1 10000000:01000000:0.0:1787387642.185286:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787387642.185316:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.185324:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.185331:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387642.185356:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650304:0@lo:101: 00000100:00100000:0.0:1787387642.185392:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387642.185423:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 000000003ba2fdf6 going to sleep for 11 seconds 00000100:00100000:2.0:1787387642.187807:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709650304 00000100:00100000:2.0:1787387642.187822:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709650304 00000100:00100000:2.0:1787387642.188221:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387642.188231:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052626dae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:5788:x1874211709650304:12345-0@lo:101: 00010000:00010000:2.0:1787387642.188246:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387642.188264:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004cb6d761/0x93d41aeaa23c73b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c73b2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.188289:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004cb6d761/0x93d41aeaa23c73b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c73b2 expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.188300:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004cb6d761/0x93d41aeaa23c73b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c73b2 expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.188308:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004cb6d761, rc 0) 00000100:00100000:2.0:1787387642.188377:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052626dae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+10:5788:x1874211709650304:12345-0@lo:101: Request processed in 148us (2985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387642.188383:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787387642.190563:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650304:0@lo:101: 00010000:00010000:0.0:1787387642.190591:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.190602:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387642.191487:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650432:0@lo:256: 00000100:00100000:0.0:1787387642.191554:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387642.191598:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 000000003ba2fdf6 going to sleep for 11 seconds 00000100:00100000:0.0:1787387642.191622:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709650432 00000100:00100000:0.0:1787387642.191628:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709650432 00000100:00100000:0.0:1787387642.191674:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387642.191681:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001afeb5b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+10:5788:x1874211709650432:12345-0@lo:256: 20000000:01000000:0.0:1787387642.191700:0:5801:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787387642.191705:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787387642.191799:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001afeb5b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+10:5788:x1874211709650432:12345-0@lo:256: Request processed in 118us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387642.191807:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387642.191846:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650432:0@lo:256: 10000000:01000000:0.0:1787387642.196254:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787387642.196279:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.196306:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387642.196315:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4350ce4000 from 1 10000000:01000000:0.0:1787387642.196318:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387642.196358:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.196366:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.196376:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387642.196398:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650560:0@lo:101: 00000100:00100000:0.0:1787387642.196457:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387642.196511:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 000000003ba2fdf6 going to sleep for 11 seconds 00000100:00100000:3.0:1787387642.197162:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709650560 00000100:00100000:3.0:1787387642.197171:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709650560 00000100:00100000:3.0:1787387642.197220:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787387642.197228:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc73540b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+10:5788:x1874211709650560:12345-0@lo:101: 00010000:00010000:3.0:1787387642.197241:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387642.197255:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006fddd762/0x93d41aeaa23c73c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c73c0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387642.197276:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006fddd762/0x93d41aeaa23c73c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c73c0 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387642.197287:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006fddd762/0x93d41aeaa23c73c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c73c0 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387642.197302:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006fddd762, rc 0) 00000100:00100000:3.0:1787387642.197358:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc73540b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:5788:x1874211709650560:12345-0@lo:101: Request processed in 130us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387642.197365:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787387642.198093:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650560:0@lo:101: 00010000:00010000:0.0:1787387642.198113:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.198122:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387642.198184:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650688:0@lo:501: 00000100:00100000:0.0:1787387642.198221:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387642.198252:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 000000003ba2fdf6 going to sleep for 11 seconds 00000100:00100000:2.0:1787387642.198317:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709650688 00000100:00100000:2.0:1787387642.198323:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709650688 00000100:00100000:2.0:1787387642.198358:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387642.198365:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e627db70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:5788:x1874211709650688:12345-0@lo:501: 00000100:00100000:2.0:1787387642.199249:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e627db70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:5788:x1874211709650688:12345-0@lo:501: Request processed in 882us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387642.199257:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787387642.199972:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650688:0@lo:501: 00000100:00100000:0.0:1787387642.200017:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650816:0@lo:503: 00000100:00100000:0.0:1787387642.200080:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387642.200113:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 000000003ba2fdf6 going to sleep for 11 seconds 00000100:00100000:1.0:1787387642.200316:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709650816 00000100:00100000:1.0:1787387642.200322:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709650816 00000100:00100000:1.0:1787387642.200364:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787387642.200372:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008619d976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:5788:x1874211709650816:12345-0@lo:503: 00000040:00080000:1.0:1787387642.200412:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787387642.200459:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008619d976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:5788:x1874211709650816:12345-0@lo:503: Request processed in 88us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387642.200466:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787387642.200672:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650816:0@lo:503: 00000040:00080000:0.0:1787387642.202353:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787387642.202515:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787387642.202534:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387642.202554:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.202566:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387642.202609:0:5788:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787387642.202613:0:5788:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d4350ce4000 10000000:01000000:2.0:1787387642.202616:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d4350ce4000 10000000:01000000:2.0:1787387642.202620:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787387642.202625:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4350ce4000 from 1 10000000:01000000:2.0:1787387642.202628:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787387642.202657:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 0000000090a83073/0x93d41aeaa23c73ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.202664:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 0000000090a83073/0x93d41aeaa23c73ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.202673:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 0000000090a83073/0x93d41aeaa23c73ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387642.202692:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650944:0@lo:101: 00000100:00100000:2.0:1787387642.202793:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387642.202826:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bf940e1b going to sleep for 11 seconds 00000100:00100000:3.0:1787387642.203188:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709650944 00000100:00100000:3.0:1787387642.203196:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709650944 00000100:00100000:3.0:1787387642.203252:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387642.203259:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000764aaa48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:5788:x1874211709650944:12345-0@lo:101: 00010000:00010000:3.0:1787387642.203271:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387642.203283:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005baafeee/0x93d41aeaa23c73d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c73ce expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387642.203305:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005baafeee/0x93d41aeaa23c73d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c73ce expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387642.203315:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005baafeee/0x93d41aeaa23c73d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c73ce expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387642.203323:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005baafeee, rc 0) 00000100:00100000:3.0:1787387642.203368:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000764aaa48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5788:x1874211709650944:12345-0@lo:101: Request processed in 109us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387642.203375:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387642.204390:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709650944:0@lo:101: 00010000:00010000:2.0:1787387642.204411:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 0000000090a83073/0x93d41aeaa23c73ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.204421:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 0000000090a83073/0x93d41aeaa23c73ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387642.204490:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709651072:0@lo:501: 00000100:00100000:2.0:1787387642.204530:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387642.204568:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bf940e1b going to sleep for 11 seconds 00000100:00100000:3.0:1787387642.204694:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709651072 00000100:00100000:3.0:1787387642.204699:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709651072 00000100:00100000:3.0:1787387642.204735:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787387642.204766:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd53d186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5788:x1874211709651072:12345-0@lo:501: 00000100:00100000:3.0:1787387642.205382:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd53d186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5788:x1874211709651072:12345-0@lo:501: Request processed in 615us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387642.205398:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787387642.206362:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098e2e320 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709651072:0@lo:501: 00000100:00100000:0.0:1787387642.206411:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709651200:0@lo:503: 00000100:00100000:0.0:1787387642.206463:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387642.206547:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c006642e going to sleep for 11 seconds 00010000:00010000:3.0:1787387642.206649:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387642.206684:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709651200 00000100:00100000:1.0:1787387642.206691:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709651200 00000100:00100000:1.0:1787387642.208714:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787387642.208729:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034dd298f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5788:x1874211709651200:12345-0@lo:503: 00000100:00100000:1.0:1787387642.209200:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034dd298f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5788:x1874211709651200:12345-0@lo:503: Request processed in 476us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387642.209209:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387642.209315:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709651200:0@lo:503: 00000100:00100000:0.0:1787387642.210354:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5835:1874211709651328:0@lo:502: 00000100:00100000:0.0:1787387642.210412:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387642.210628:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set 000000000502d58b going to sleep for 11 seconds 00000100:00100000:2.0:1787387642.210673:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709651328 00000100:00100000:2.0:1787387642.210680:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709651328 00000100:00100000:2.0:1787387642.210870:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787387642.210878:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f317232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5835:x1874211709651328:12345-0@lo:502: 00000100:00100000:2.0:1787387642.211386:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f317232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5835:x1874211709651328:12345-0@lo:502: Request processed in 507us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387642.211395:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387642.211536:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5835:1874211709651328:0@lo:502: 00000020:01000004:0.0:1787387642.211594:0:5835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787387642.211608:0:5835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000013f0ffa1) 00000020:00000080:0.0:1787387642.211626:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787387642.217806:0:5835:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000058134b71 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787387642.217818:0:5835:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000058134b71 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787387642.217822:0:5835:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000058134b71 4 00010000:00080000:0.0:1787387642.217866:0:5835:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d6bfe85e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1787387642.225547:0:5835:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787387642.225659:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787387642.225696:0:5835:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787387642.225712:0:5835:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x93d41aeaa23c73e3 00000100:00080000:0.0:1787387642.225722:0:5835:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787387642.225727:0:5835:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d6bfe85e using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1787387642.225785:0:5835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008331b5fe x1874211709651456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787387642.225818:0:5835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787387642.227069:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874211709651456:0@lo:38: 00000100:00100000:3.0:1787387642.227158:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387642.227236:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709651456 00000100:00100000:3.0:1787387642.227243:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709651456 00000100:00100000:3.0:1787387642.227282:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387642.227289:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a63958c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874211709651456:12345-0@lo:38: 00000100:00100000:3.0:1787387642.227342:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a63958c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874211709651456:12345-0@lo:38: Request processed in 52us (184us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787387642.227348:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387642.227383:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787387642.227391:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000d6bfe85e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787387642.227394:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787387642.227397:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008331b5fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874211709651456:0@lo:38: 00000100:00100000:3.0:1787387642.235421:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd31d819 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5835:1874211709651584:0@lo:502: 00000100:00100000:3.0:1787387642.235514:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387642.235556:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a9d0c5ed going to sleep for 11 seconds 00000100:00100000:2.0:1787387642.235664:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709651584 00000100:00100000:2.0:1787387642.235672:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709651584 00000100:00100000:2.0:1787387642.235757:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787387642.235765:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c665d3e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5835:x1874211709651584:12345-0@lo:502: 00000100:00100000:2.0:1787387642.236297:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c665d3e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5835:x1874211709651584:12345-0@lo:502: Request processed in 531us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387642.236307:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787387642.236502:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd31d819 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5835:1874211709651584:0@lo:502: 00000040:00080000:3.0:1787387642.236531:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787387642.236614:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787387642.236630:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787387642.236645:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 0000000090a83073/0x93d41aeaa23c73ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387642.236655:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 0000000090a83073/0x93d41aeaa23c73ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787387642.236714:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787387642.236716:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787387642.236718:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387642.236719:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387642.236720:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387642.236721:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387642.236722:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387642.236724:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787387642.236725:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787387642.236726:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787387642.236728:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387642.236729:0:5788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787387642.236734:0:5788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787387642.236753:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787387642.236754:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787387642.236755:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387642.236756:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387642.236757:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387642.236758:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387642.236759:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387642.236760:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787387642.236761:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787387642.236762:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787387642.236763:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387642.236764:0:5788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787387642.236781:0:5788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787387642.236793:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd31d819 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709651712:0@lo:253: 00000100:00100000:3.0:1787387642.236827:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387642.236850:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a9d0c5ed going to sleep for 11 seconds 00000100:00100000:3.0:1787387642.237186:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709651712 00000100:00100000:3.0:1787387642.237192:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709651712 00000100:00100000:3.0:1787387642.237221:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387642.237227:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005abd857e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5788:x1874211709651712:12345-0@lo:253: 20000000:01000000:3.0:1787387642.237259:0:5801:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787387642.237273:0:5801:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787387642.290369:0:5801:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787387642.290392:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787387642.290504:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787387642.290509:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787387642.290532:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.290552:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004cb6d761/0x93d41aeaa23c73b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c73b2 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.290559:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.290593:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004cb6d761/0x93d41aeaa23c73b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c73b2 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.290606:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004cb6d761/0x93d41aeaa23c73b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c73b2 expref: 12 pid: 5800 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387642.290620:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ece79341 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1874211709651840:0@lo:104: 00000100:00100000:0.0:1787387642.290678:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387642.290838:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709651840 00000100:00100000:1.0:1787387642.290846:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709651840 00000100:00100000:1.0:1787387642.290913:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387642.290936:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000966e0859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:5823:x1874211709651840:12345-0@lo:104: 00010000:00010000:1.0:1787387642.290947:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.291007:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787387642.291012:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000966e0859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:5823:x1874211709651840:12345-0@lo:104: Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387642.291019:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387642.291154:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 0000000008fc9c8c going to sleep for 11 seconds 00000100:00100000:0.0:1787387642.291177:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ece79341 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1874211709651840:0@lo:104: 00010000:00010000:0.0:1787387642.291195:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.298794:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387642.298830:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.298844:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000750ff964 already unused, calling callback (000000002c4d5663) 10000000:00010000:2.0:1787387642.298847:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.298864:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387642.298872:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387642.298877:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387642.299171:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.299179:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387642.299208:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.299214:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 00000000750ff964/0x93d41aeaa23c73b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387642.299236:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387642.299238:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387642.299239:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387642.299331:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387642.299347:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000029a76f14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709651968:0@lo:103: 00000100:00100000:2.0:1787387642.299409:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387642.300231:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709651968 00000100:00100000:1.0:1787387642.300244:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709651968 00010000:00010000:1.0:1787387642.300278:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004cb6d761/0x93d41aeaa23c73b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c73b2 expref: 13 pid: 5800 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387642.300366:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387642.300375:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061c276a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:3311:x1874211709651968:12345-0@lo:103: 00010000:00010000:1.0:1787387642.300389:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387642.300394:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004cb6d761/0x93d41aeaa23c73b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c73b2 expref: 13 pid: 5800 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.300406:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004cb6d761/0x93d41aeaa23c73b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c73b2 expref: 13 pid: 5800 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.300422:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004cb6d761/0x93d41aeaa23c73b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c73b2 expref: 13 pid: 5800 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.300437:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.300444:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787387642.300476:0:5792:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009967124s 00010000:00010000:1.0:1787387642.300481:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.300488:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.300494:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.300499:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.300504:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc8b68d0 already unused, calling callback (000000005b070e73) 00010000:00010000:1.0:1787387642.300509:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.300515:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.300525:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387642.300534:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387642.300588:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061c276a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:3311:x1874211709651968:12345-0@lo:103: Request processed in 215us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387642.300595:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387642.300692:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000029a76f14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709651968:0@lo:103: 00010000:00010000:0.0:1787387642.301032:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.301041:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387642.301046:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cc8b68d0/0x93d41aeaa23c73ea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387642.311444:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005abd857e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:5788:x1874211709651712:12345-0@lo:253: Request processed in 74209us (74609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387642.311459:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787387642.311623:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd31d819 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5788:1874211709651712:0@lo:253: 10000000:01000000:0.0:1787387642.311637:0:5788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787387642.311641:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787387642.311643:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787387642.311644:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387642.311645:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787387642.311646:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387642.311647:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387642.311648:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787387642.311650:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787387642.311651:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787387642.311652:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787387642.311653:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387642.311654:0:5788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787387642.311668:0:5788:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787387642.323588:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787387642.324405:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787387642.324711:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787387642.325306:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787387642.325846:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787387642.326146:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787387642.328850:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787387642.329058:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787387642.329267:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787387642.329651:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787387642.330201:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787387642.330426:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787387642.422625:0:5788:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787387642.513044:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787387642.513178:0:5840:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787387642.513182:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787387642.513766:0:5841:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787387642.523505:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787387642.523763:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787387642.524181:0:5788:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787387642.524189:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787387642.524319:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387642.527160:0:5788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787387642.528641:0:5788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787387642.539797:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787387642.540090:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787387642.540276:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787387642.541450:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787387642.541600:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787387642.541731:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787387642.541899:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787387642.550009:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787387642.550155:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787387642.550293:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787387642.551247:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787387642.551599:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787387642.551786:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787387642.552175:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787387642.554460:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787387642.554751:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787387642.554927:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787387642.555075:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787387642.555236:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787387642.555521:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787387642.556309:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787387642.559441:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787387642.559611:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787387642.559791:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787387642.560205:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787387642.561273:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787387642.561690:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787387642.567773:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787387642.568008:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787387642.568144:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787387642.569910:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787387642.570068:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787387642.570207:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787387642.570347:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787387642.570480:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787387642.570645:0:5788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787387642.616630:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787387642.710639:0:5788:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787387642.710675:0:5788:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb034c18ff988 00100000:10000000:2.0:1787387642.710684:0:5788:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787387642.711495:0:5788:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787387642.711511:0:5788:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787387642.711524:0:5788:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787387642.711550:0:5788:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787387642.753522:0:5841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787387642.753605:0:5841:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787387642.753610:0:5841:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787387643.231958:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387644.253994:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387645.280099:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387646.307398:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787387646.558939:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787387646.558947:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4350ce4000 from 3 10000000:01000000:0.0:1787387646.558951:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787387646.558999:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000dcb6aff0/0x93d41aeaa23c73f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387646.559011:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000dcb6aff0/0x93d41aeaa23c73f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387646.559030:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000dcb6aff0/0x93d41aeaa23c73f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387646.559065:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ece79341 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709652096:0@lo:101: 00000100:00100000:0.0:1787387646.559133:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387646.559188:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2a34633 going to sleep for 11 seconds 00000100:00100000:2.0:1787387646.559301:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709652096 00000100:00100000:2.0:1787387646.559310:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709652096 00000100:00100000:2.0:1787387646.559366:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787387646.559374:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000388a5d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:5804:x1874211709652096:12345-0@lo:101: 00010000:00010000:2.0:1787387646.559387:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387646.559399:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000289ca029/0x93d41aeaa23c73f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c73f1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387646.559419:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000289ca029/0x93d41aeaa23c73f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c73f1 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387646.559427:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000289ca029/0x93d41aeaa23c73f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c73f1 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387646.559446:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000289ca029, rc 0) 00000100:00100000:2.0:1787387646.559485:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000388a5d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5804:x1874211709652096:12345-0@lo:101: Request processed in 112us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387646.559491:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787387646.559531:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ece79341 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709652096:0@lo:101: 00010000:00010000:2.0:1787387646.559544:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000dcb6aff0/0x93d41aeaa23c73f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387646.559552:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000dcb6aff0/0x93d41aeaa23c73f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387646.559596:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000029a76f14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709652224:0@lo:256: 00000100:00100000:2.0:1787387646.559624:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387646.559639:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f5f4e678 going to sleep for 11 seconds 00000100:00100000:2.0:1787387646.559651:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709652224 00000100:00100000:2.0:1787387646.559654:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709652224 00000100:00100000:2.0:1787387646.559674:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787387646.559679:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d165a013 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5804:x1874211709652224:12345-0@lo:256: 20000000:01000000:2.0:1787387646.559691:0:5801:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787387646.559708:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787387646.559711:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787387646.559811:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d165a013 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5804:x1874211709652224:12345-0@lo:256: Request processed in 132us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387646.559818:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787387646.559863:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000029a76f14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709652224:0@lo:256: 10000000:01000000:2.0:1787387646.559909:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787387646.559918:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000dcb6aff0/0x93d41aeaa23c73f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387646.559925:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000dcb6aff0/0x93d41aeaa23c73f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387647.330078:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787387647.444258:0:6084:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787387647.583989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787387647.584000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787387647.584003:0:36:0:(import.c:65:import_set_state_nolock()) 00000000d6bfe85e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787387647.584014:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d6bfe85e using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1787387647.584036:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b4ff9a91 x1874211709652480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787387647.584076:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b4ff9a91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874211709652480:0@lo:38: 00000100:00100000:1.0:1787387647.584206:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387647.584298:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709652480 00000100:00100000:1.0:1787387647.584306:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709652480 00000100:00100000:1.0:1787387647.584339:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387647.584346:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000713c4fc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874211709652480:12345-0@lo:38: 00010000:00080000:1.0:1787387647.584377:0:5809:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:1.0:1787387647.584410:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x93d41aeaa23c73ff 00000004:00100000:1.0:1787387647.584449:0:5809:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787387647.584562:0:5809:0:(import.c:65:import_set_state_nolock()) 00000000b56f0327 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387647.584611:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000713c4fc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874211709652480:12345-0@lo:38: Request processed in 264us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387647.584619:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787387647.584661:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b4ff9a91 x1874211709652480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787387647.584674:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787387647.584680:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787387647.584684:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787387647.584686:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000d6bfe85e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787387647.584691:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b4ff9a91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874211709652480:0@lo:38: 00000100:00100000:1.0:1787387647.584999:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387647.585009:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c5403a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709652352:0@lo:400: 00000100:00100000:1.0:1787387647.585042:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387647.585960:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709652352 00000100:00100000:2.0:1787387647.585969:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709652352 00000100:00100000:2.0:1787387647.586012:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787387647.586018:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000382e1fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:3314:x1874211709652352:12345-0@lo:400: 00000100:00100000:2.0:1787387647.586076:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000382e1fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:3314:x1874211709652352:12345-0@lo:400: Request processed in 58us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387647.586082:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787387647.586125:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c5403a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709652352:0@lo:400: 00010000:00010000:2.0:1787387648.349977:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387649.376032:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387650.404886:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387651.425793:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387652.451889:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787387652.576526:0:6286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd5880b820 00000020:00000080:0.0:1787387652.576545:0:6286:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787387652.576550:0:6286:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787387652.576557:0:6286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5880dab0 20000000:00000080:0.0:1787387652.576563:0:6286:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d4345dcb400 uarg=0000000000000000 20000000:01000000:0.0:1787387652.576595:0:6286:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787387652.576602:0:6286:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787387652.576606:0:6286:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787387652.577179:0:6286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787387652.577191:0:6286:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787387652.582348:0:6286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387652.582605:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787387652.582888:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787387652.582941:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787387652.582960:0:6286:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787387652.582978:0:6286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387652.582998:0:6286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006fddd762/0x93d41aeaa23c73c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c73c0 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387652.583005:0:6286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387652.583052:0:6286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006fddd762/0x93d41aeaa23c73c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c73c0 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387652.584228:0:6286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006fddd762/0x93d41aeaa23c73c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c73c0 expref: 11 pid: 5801 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387652.584245:0:6286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000233a7661 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6286:1874211709652608:0@lo:104: 00000100:00100000:0.0:1787387652.584312:0:6286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387652.584381:0:6286:0:(client.c:2702:ptlrpc_set_wait()) set 000000000502d58b going to sleep for 11 seconds 00000100:00100000:2.0:1787387652.585536:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709652608 00000100:00100000:2.0:1787387652.585548:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709652608 00000100:00100000:2.0:1787387652.585647:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787387652.585666:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050dc1900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:6286:x1874211709652608:12345-0@lo:104: 00010000:00010000:2.0:1787387652.585681:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387652.585788:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387652.585794:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050dc1900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:6286:x1874211709652608:12345-0@lo:104: Request processed in 139us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387652.585813:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787387652.585864:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387652.585869:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.585877:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a3df065 already unused, calling callback (000000002c4d5663) 10000000:00010000:3.0:1787387652.585880:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.585887:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387652.585900:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387652.585905:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787387652.585941:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.585947:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387652.585966:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.585972:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 000000000a3df065/0x93d41aeaa23c73c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.585991:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387652.585993:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387652.585994:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387652.586014:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004b8e324c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709652736:0@lo:103: 00000100:00100000:3.0:1787387652.586046:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387652.586112:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709652736 00000100:00100000:3.0:1787387652.586116:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709652736 00010000:00010000:3.0:1787387652.586133:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006fddd762/0x93d41aeaa23c73c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c73c0 expref: 12 pid: 5801 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387652.586154:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387652.586160:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fa40cca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:3314:x1874211709652736:12345-0@lo:103: 00010000:00010000:3.0:1787387652.586170:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387652.586174:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006fddd762/0x93d41aeaa23c73c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c73c0 expref: 12 pid: 5801 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.586190:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006fddd762/0x93d41aeaa23c73c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c73c0 expref: 12 pid: 5801 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.586216:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.586223:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.586237:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.586242:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.586248:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.586253:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.586257:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000894772ba already unused, calling callback (000000005b070e73) 00010000:00010000:3.0:1787387652.586261:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.586267:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.586275:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387652.586295:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387652.586323:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fa40cca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:3314:x1874211709652736:12345-0@lo:103: Request processed in 163us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387652.586329:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387652.586362:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004b8e324c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709652736:0@lo:103: 00010000:00010000:0.0:1787387652.586714:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006fddd762/0x93d41aeaa23c73c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c73c0 expref: 11 pid: 5801 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387652.586725:0:6286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000233a7661 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6286:1874211709652608:0@lo:104: 00010000:00010000:0.0:1787387652.586775:0:6286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387652.586784:0:6286:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387652.586789:0:6286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387652.586794:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000894772ba/0x93d41aeaa23c7406 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387652.702551:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004b8e324c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709652864:0@lo:400: 00000100:00100000:0.0:1787387652.702618:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387652.703341:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709652864 00000100:00100000:3.0:1787387652.703350:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709652864 00000100:00100000:3.0:1787387652.703401:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387652.703408:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000233a7661 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709652864:12345-0@lo:400: 00000100:00100000:3.0:1787387652.703467:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000233a7661 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709652864:12345-0@lo:400: Request processed in 59us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387652.703473:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787387652.709472:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004b8e324c x1874211709652864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387652.709512:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004b8e324c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709652864:0@lo:400: 00010000:00010000:2.0:1787387653.469914:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787387654.045944:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787387654.045955:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4350ce4000 from 1 10000000:01000000:3.0:1787387654.045960:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787387654.046015:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000439be306/0x93d41aeaa23c740d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387654.046027:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000439be306/0x93d41aeaa23c740d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387654.046037:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000439be306/0x93d41aeaa23c740d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387654.046060:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005a0ad497 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709652992:0@lo:101: 00000100:00100000:3.0:1787387654.046137:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387654.046190:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set 0000000090d827e9 going to sleep for 11 seconds 00000100:00100000:2.0:1787387654.046253:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709652992 00000100:00100000:2.0:1787387654.046263:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709652992 00000100:00100000:2.0:1787387654.046325:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787387654.046333:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000961b0e10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:5804:x1874211709652992:12345-0@lo:101: 00010000:00010000:2.0:1787387654.046347:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387654.046361:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008b4d8b54/0x93d41aeaa23c7414 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c740d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387654.046384:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b4d8b54/0x93d41aeaa23c7414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c740d expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387654.046404:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008b4d8b54/0x93d41aeaa23c7414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c740d expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387654.046413:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008b4d8b54, rc 0) 00000100:00100000:2.0:1787387654.046467:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000961b0e10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5804:x1874211709652992:12345-0@lo:101: Request processed in 136us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387654.046474:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787387654.046771:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005a0ad497 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709652992:0@lo:101: 00010000:00010000:0.0:1787387654.046786:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000439be306/0x93d41aeaa23c740d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387654.046793:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000439be306/0x93d41aeaa23c740d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387654.046848:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a8ed130a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709653120:0@lo:501: 00000100:00100000:0.0:1787387654.046891:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387654.046909:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2a34633 going to sleep for 11 seconds 00000100:00100000:0.0:1787387654.046924:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709653120 00000100:00100000:0.0:1787387654.046928:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709653120 00000100:00100000:0.0:1787387654.046952:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787387654.046957:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e202ecb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5804:x1874211709653120:12345-0@lo:501: 00000100:00100000:0.0:1787387654.047200:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e202ecb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5804:x1874211709653120:12345-0@lo:501: Request processed in 242us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387654.047206:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787387654.047236:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a8ed130a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709653120:0@lo:501: 00000100:00100000:0.0:1787387654.047277:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a8ed130a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709653248:0@lo:503: 00000100:00100000:0.0:1787387654.047314:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387654.047327:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2a34633 going to sleep for 11 seconds 00000100:00100000:0.0:1787387654.047414:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709653248 00000100:00100000:0.0:1787387654.047418:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709653248 00000100:00100000:0.0:1787387654.047434:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387654.047446:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d52e9fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5804:x1874211709653248:12345-0@lo:503: 00000100:00100000:0.0:1787387654.048577:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d52e9fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5804:x1874211709653248:12345-0@lo:503: Request processed in 1128us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387654.048652:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787387654.054588:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a8ed130a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709653248:0@lo:503: 00000100:00100000:3.0:1787387654.058083:0:6345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087707a99 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6345:1874211709653376:0@lo:502: 00000100:00100000:3.0:1787387654.058181:0:6345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387654.058241:0:6345:0:(client.c:2702:ptlrpc_set_wait()) set 0000000090d827e9 going to sleep for 11 seconds 00000100:00100000:1.0:1787387654.058467:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709653376 00000100:00100000:1.0:1787387654.058475:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709653376 00000100:00100000:1.0:1787387654.058546:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787387654.058554:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069edae70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6345:x1874211709653376:12345-0@lo:502: 00000100:00100000:1.0:1787387654.058831:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069edae70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6345:x1874211709653376:12345-0@lo:502: Request processed in 278us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387654.058839:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787387654.059211:0:6345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087707a99 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6345:1874211709653376:0@lo:502: 00000020:01000000:3.0:1787387654.059248:0:6345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387654.059258:0:6345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387654.059261:0:6345:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787387654.059268:0:6345:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4350ce4000 00000020:00000080:3.0:1787387654.059271:0:6345:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787387654.059329:0:6345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6345:1874211709653504:0@lo:502: 00000100:00100000:3.0:1787387654.059368:0:6345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387654.059396:0:6345:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347c60f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387654.059565:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709653504 00000100:00100000:1.0:1787387654.059571:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709653504 00000100:00100000:1.0:1787387654.059851:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787387654.059859:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6345:x1874211709653504:12345-0@lo:502: 00000100:00100000:1.0:1787387654.060033:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6345:x1874211709653504:12345-0@lo:502: Request processed in 174us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387654.060039:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787387654.061824:0:6345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6345:1874211709653504:0@lo:502: 00000020:01000000:3.0:1787387654.061869:0:6345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387654.061878:0:6345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387654.061880:0:6345:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787387654.061884:0:6345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787387654.062238:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787387654.062265:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787387654.062278:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c740d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387654.062289:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c740d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387654.494356:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387655.522093:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387656.547881:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387657.571434:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387657.836492:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709653632:0@lo:400: 00000100:00100000:1.0:1787387657.836704:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387657.836976:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709653760:0@lo:400: 00000100:00100000:1.0:1787387657.837009:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387657.837050:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709653632 00000100:00100000:1.0:1787387657.837057:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709653632 00000100:00100000:1.0:1787387657.837115:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787387657.837123:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:3312:x1874211709653632:12345-0@lo:400: 00000100:00100000:1.0:1787387657.837174:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:3312:x1874211709653632:12345-0@lo:400: Request processed in 51us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387657.837180:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787387657.837209:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709653760 00000100:00100000:1.0:1787387657.837213:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709653760 00000100:00100000:1.0:1787387657.837239:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387657.837246:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709653760:12345-0@lo:400: 00000100:00100000:1.0:1787387657.837294:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709653760:12345-0@lo:400: Request processed in 49us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387657.837301:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787387657.837342:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d4374176a00 x1874211709653760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387657.837356:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709653760:0@lo:400: 00000100:00100000:1.0:1787387657.837381:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709653632:0@lo:400: 00000020:01000004:0.0:1787387658.566683:0:6600:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787387658.566687:0:6600:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787387658.566857:0:6600:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d4379110800 00000020:01000004:0.0:1787387658.566874:0:6600:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787387658.566885:0:6600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787387658.566898:0:6600:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d43747d0000) 00000020:00000080:0.0:1787387658.566913:0:6600:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787387658.586701:0:6600:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787387658.587065:0:6600:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:3.0:1787387658.590200:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787387658.617332:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787387658.624335:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787387658.624370:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787387658.624425:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787387658.624449:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787387658.625230:0:6600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787387658.625243:0:6600:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787387658.625254:0:6600:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x93d41aeaa23c7422 00000020:01000004:0.0:1787387658.625267:0:6600:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787387658.625291:0:6600:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787387658.625294:0:6600:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787387658.625301:0:6600:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787387658.625306:0:6600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787387658.625319:0:6600:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d43747d19c0) 00000020:00000080:0.0:1787387658.625330:0:6600:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787387658.629050:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787387658.630297:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787387658.630313:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787387658.631569:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787387658.631581:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787387658.634022:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787387658.634034:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787387658.639837:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387658.640008:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787387658.640014:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787387658.647922:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787387658.647937:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787387658.700957:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387658.701210:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787387658.701216:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787387658.708201:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787387658.708217:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787387658.710442:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787387658.710521:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787387658.719112:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787387658.719309:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787387658.719315:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787387658.725415:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787387658.725428:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787387658.823763:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387658.823969:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787387658.823976:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787387658.826792:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787387658.826813:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787387658.827326:0:6600:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787387658.827351:0:6600:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787387658.827358:0:6600:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787387658.872482:0:6600:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787387658.872532:0:6600:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787387658.872537:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787387658.872539:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387658.872540:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387658.872541:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387658.872543:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387658.872544:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387658.872546:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387658.872548:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387658.872549:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387658.872551:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387658.872557:0:6600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787387658.872560:0:6600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787387658.872562:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787387658.872563:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387658.872564:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387658.872565:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387658.872566:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387658.872567:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387658.872567:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387658.872568:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387658.872569:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387658.872570:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387658.872571:0:6600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787387658.872596:0:6600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787387658.872611:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374177b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709653888:0@lo:253: 00000100:00100000:1.0:1787387658.872695:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387658.872939:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373aa4780 going to sleep for 11 seconds 00000100:00100000:3.0:1787387658.873090:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709653888 00000100:00100000:3.0:1787387658.873098:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709653888 00000100:00100000:3.0:1787387658.873197:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787387658.873209:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6600:x1874211709653888:12345-0@lo:253: 20000000:01000000:3.0:1787387658.873240:0:5800:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787387658.873245:0:5800:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787387658.873250:0:5800:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787387658.873254:0:5800:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787387658.874379:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787387658.874725:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787387658.874826:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787387658.874871:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1787387658.874879:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787387658.874911:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1787387658.874962:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1787387658.875612:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787387658.875736:0:5800:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:3.0:1787387658.875767:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:3.0:1787387658.875811:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787387658.875820:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787387658.875867:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787387658.875876:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:3.0:1787387658.875908:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787387658.875918:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787387658.875949:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787387658.876018:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787387658.877369:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787387658.877401:0:5800:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:3.0:1787387658.877404:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:3.0:1787387658.877662:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787387658.877671:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787387658.877706:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787387658.877713:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:3.0:1787387658.878022:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787387658.878034:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787387658.878071:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787387658.878107:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787387658.878125:0:5800:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787387658.878128:0:5800:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787387658.878131:0:5800:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787387658.878143:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787387658.878145:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787387658.878341:0:5800:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787387658.878344:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787387658.879351:0:6616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787387658.879926:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787387658.879974:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787387658.880044:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787387658.880056:0:5800:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787387658.880059:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787387658.881064:0:6617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787387658.881131:0:6617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787387658.881260:0:6617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787387658.881941:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787387658.881988:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787387658.882024:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787387658.882035:0:5800:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787387658.882038:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787387658.883117:0:6618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1787387658.883325:0:6618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1787387658.883386:0:6618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787387658.883911:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787387658.883955:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787387658.884027:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787387658.884044:0:5800:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787387658.884046:0:5800:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787387658.884057:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787387658.884091:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387658.884109:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d434152ea00/0x93d41aeaa23c7349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7342 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387658.884117:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c735e expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387658.884124:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c73d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c73ce expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387658.884132:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387658.884305:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c73d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c73ce expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387658.884321:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c73d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c73ce expref: 12 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387658.884339:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1874211709654016:0@lo:104: 00000100:00100000:3.0:1787387658.884412:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387658.884734:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c735e expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387658.884768:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c735e expref: 12 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387658.884776:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1874211709654144:0@lo:104: 00000100:00100000:3.0:1787387658.884800:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387658.885789:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d434152ea00/0x93d41aeaa23c7349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c7342 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387658.885803:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d434152ea00/0x93d41aeaa23c7349 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c7342 expref: 12 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387658.885814:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1874211709654272:0@lo:104: 00000100:00100000:3.0:1787387658.885849:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387658.886617:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709654016 00000100:00100000:2.0:1787387658.886628:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709654016 00000100:00100000:2.0:1787387658.886689:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709654144 00000100:00100000:2.0:1787387658.886693:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709654144 00000100:00100000:2.0:1787387658.886709:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387658.886720:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:5800:x1874211709654016:12345-0@lo:104: 00010000:00010000:2.0:1787387658.886736:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c73ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387658.887032:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709654272 00000100:00100000:0.0:1787387658.887038:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709654272 00010000:00010000:2.0:1787387658.887235:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387658.887243:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:5800:x1874211709654016:12345-0@lo:104: Request processed in 525us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387658.887251:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387658.887272:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387658.887279:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:5800:x1874211709654144:12345-0@lo:104: 00010000:00010000:2.0:1787387658.887288:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d43413fc200/0x93d41aeaa23c735e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.887339:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387658.887347:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c73ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.887355:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc600 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387658.887360:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c73ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.887369:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c73ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387658.887376:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c73ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387658.887382:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787387658.887471:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435229d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787387658.887682:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1874211709654016:0@lo:104: 00000100:00100000:3.0:1787387658.887693:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1874211709654144:0@lo:104: 00010000:00010000:0.0:1787387658.887781:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c73ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.887798:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387658.887820:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c73ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.887826:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c73ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.887852:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387658.887856:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d43413fc200/0x93d41aeaa23c735e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.887862:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc200 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387658.887865:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fc200/0x93d41aeaa23c735e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.887871:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d43413fc200/0x93d41aeaa23c735e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387658.887878:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fc200/0x93d41aeaa23c735e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387658.887883:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787387658.887931:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709654400:0@lo:103: 00000100:00100000:3.0:1787387658.887967:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387658.888004:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709654400 00000100:00100000:3.0:1787387658.888009:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709654400 00010000:00010000:3.0:1787387658.888030:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c73d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c73ce expref: 13 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387658.888051:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387658.888058:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:3314:x1874211709654400:12345-0@lo:103: 00010000:00010000:3.0:1787387658.888083:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387658.888090:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c73d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c73ce expref: 13 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387658.888100:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c73d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c73ce expref: 13 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387658.888113:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c73d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c73ce expref: 13 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387658.888134:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387658.888164:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:3314:x1874211709654400:12345-0@lo:103: Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387658.888184:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387658.888217:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709654400:0@lo:103: 00010000:00010000:2.0:1787387658.889305:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787387658.889318:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:5800:x1874211709654144:12345-0@lo:104: Request processed in 2038us (4514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387658.889328:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387658.889355:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387658.889366:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:5800:x1874211709654272:12345-0@lo:104: 00010000:00010000:2.0:1787387658.889377:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c7342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.889787:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d43413fc200/0x93d41aeaa23c735e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.889796:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387658.889815:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d43413fc200/0x93d41aeaa23c735e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.889822:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d43413fc200/0x93d41aeaa23c735e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7365 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.889857:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387658.889861:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c7342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.889867:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fde00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387658.889870:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c7342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.889877:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c7342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387658.889883:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c7342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387658.889888:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387658.889904:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c7342 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.889909:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387658.889915:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c7342 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.889921:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c7342 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7349 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387658.889934:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387658.889935:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387658.889971:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387658.890074:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1874211709654272:0@lo:104: 00010000:00010000:1.0:1787387658.890097:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387658.890212:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787387658.890219:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:5800:x1874211709654272:12345-0@lo:104: Request processed in 857us (4369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387658.890226:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787387658.890325:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387658.890339:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709654528:0@lo:103: 00000100:00100000:0.0:1787387658.890380:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387658.890419:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387658.890601:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709654528 00000100:00100000:1.0:1787387658.890607:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709654528 00010000:00010000:1.0:1787387658.890629:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c735e expref: 12 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387658.890667:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387658.890675:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:3311:x1874211709654528:12345-0@lo:103: 00010000:00010000:1.0:1787387658.890686:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387658.890691:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c735e expref: 12 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.890714:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c735e expref: 12 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.890728:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c735e expref: 12 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.890758:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387658.890786:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:3311:x1874211709654528:12345-0@lo:103: Request processed in 112us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387658.890792:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387658.890848:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709654656:0@lo:103: 00000100:00100000:0.0:1787387658.890871:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387658.890906:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709654528:0@lo:103: 00000100:00100000:1.0:1787387658.890980:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709654656 00000100:00100000:1.0:1787387658.890984:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709654656 00010000:00010000:1.0:1787387658.890997:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d434152ea00/0x93d41aeaa23c7349 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7342 expref: 11 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387658.891023:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387658.891029:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:3311:x1874211709654656:12345-0@lo:103: 00010000:00010000:1.0:1787387658.891036:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387658.891039:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d434152ea00/0x93d41aeaa23c7349 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7342 expref: 11 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891048:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d434152ea00/0x93d41aeaa23c7349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c7342 expref: 11 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891057:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152ea00/0x93d41aeaa23c7349 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c7342 expref: 11 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891068:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891085:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891098:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891106:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891112:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891118:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891123:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387658.891127:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891133:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891147:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891155:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387658.891262:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+10:3311:x1874211709654656:12345-0@lo:103: Request processed in 232us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387658.891268:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787387658.891288:0:5800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891301:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387658.891307:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7430 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787387658.891319:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787387658.891400:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709654656:0@lo:103: 00010000:00010000:3.0:1787387658.894776:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387659.007099:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:6600:x1874211709653888:12345-0@lo:253: Request processed in 133881us (134391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387659.007115:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787387659.009084:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374177b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709653888:0@lo:253: 10000000:01000000:0.0:1787387659.009105:0:6600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787387659.009109:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787387659.009111:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787387659.009112:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387659.009113:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787387659.009115:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387659.009116:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387659.009118:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787387659.009119:0:6600:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787387659.009121:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387659.009122:0:6600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787387659.009152:0:6600:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d4379110800 from lustre-OST0000 10000000:01000000:0.0:1787387659.009182:0:6600:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787387659.009185:0:6600:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787387659.009192:0:6600:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d43434a99c0 local copy 10000000:01000000:0.0:1787387659.009197:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787387659.009238:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.009251:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.009262:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387659.009306:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709654784:0@lo:101: 00000100:00100000:0.0:1787387659.009490:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387659.009551:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a2a1240 going to sleep for 11 seconds 00000100:00100000:1.0:1787387659.009651:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709654784 00000100:00100000:1.0:1787387659.009657:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709654784 00000100:00100000:1.0:1787387659.009707:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787387659.009717:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:6600:x1874211709654784:12345-0@lo:101: 00010000:00010000:1.0:1787387659.009731:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387659.009775:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c743e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7437 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.009800:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c743e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7437 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.009812:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c743e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7437 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.009822:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4800, rc 0) 00000100:00100000:1.0:1787387659.009863:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+10:6600:x1874211709654784:12345-0@lo:101: Request processed in 147us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387659.009869:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787387659.009969:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709654784:0@lo:101: 00010000:00010000:0.0:1787387659.009982:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.009991:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387659.010095:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709654912:0@lo:501: 00000100:00100000:0.0:1787387659.010121:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387659.010147:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a2a1240 going to sleep for 11 seconds 00000100:00100000:1.0:1787387659.010253:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709654912 00000100:00100000:1.0:1787387659.010257:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709654912 00000100:00100000:1.0:1787387659.010287:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387659.010294:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+10:6600:x1874211709654912:12345-0@lo:501: 00000100:00100000:1.0:1787387659.010517:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+10:6600:x1874211709654912:12345-0@lo:501: Request processed in 222us (393us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787387659.010524:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787387659.010672:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709654912:0@lo:501: 10000000:01000000:0.0:1787387659.010685:0:6600:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787387659.010713:0:6600:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787387659.010719:0:6600:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.010727:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.010734:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.010832:0:6600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787387659.010860:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d4379110800 00010000:00010000:1.0:1787387659.011675:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387659.011686:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.011695:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030800 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387659.011699:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.011709:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387659.011718:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387659.011725:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387659.011796:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.011804:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387659.011834:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.011841:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c7437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x93d41aeaa23c743e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.011875:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387659.011878:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387659.011880:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387659.011890:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387659.011911:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709655040:0@lo:103: 00000100:00100000:1.0:1787387659.011965:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787387659.012012:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787387659.012021:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d43434a99c0 10000000:01000000:1.0:1787387659.012025:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787387659.012029:0:6600:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8d43434a99c0 from 1 10000000:01000000:1.0:1787387659.012033:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787387659.012056:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4e00/0x93d41aeaa23c7445 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.012065:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4e00/0x93d41aeaa23c7445 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.012073:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4e00/0x93d41aeaa23c7445 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387659.012086:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374175500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655168:0@lo:101: 00000100:00100000:1.0:1787387659.012114:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387659.012127:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754300 going to sleep for 11 seconds 00000100:00100000:1.0:1787387659.012146:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709655040 00000100:00100000:1.0:1787387659.012152:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709655040 00000100:00100000:1.0:1787387659.012197:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387659.012206:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374174a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+10:3314:x1874211709655040:12345-0@lo:103: 00010000:00010000:1.0:1787387659.012218:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387659.012240:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c743e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c7437 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.012255:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387659.012290:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374174a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:3314:x1874211709655040:12345-0@lo:103: Request processed in 85us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387659.012298:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387659.012335:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709655040:0@lo:103: 00000100:00100000:0.0:1787387659.015363:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709655168 00000100:00100000:0.0:1787387659.015390:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709655168 00000100:00100000:0.0:1787387659.015454:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787387659.015465:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+9:6600:x1874211709655168:12345-0@lo:101: 00010000:00010000:0.0:1787387659.015482:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387659.015504:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4340030e00/0x93d41aeaa23c744c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7445 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.015531:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340030e00/0x93d41aeaa23c744c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7445 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.015543:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4340030e00/0x93d41aeaa23c744c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7445 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.015552:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340030e00, rc 0) 00000100:00100000:0.0:1787387659.016034:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+10:6600:x1874211709655168:12345-0@lo:101: Request processed in 569us (3916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387659.016043:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787387659.016175:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374175500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655168:0@lo:101: 00010000:00010000:1.0:1787387659.016193:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4e00/0x93d41aeaa23c7445 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c744c expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.016204:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4e00/0x93d41aeaa23c7445 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c744c expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387659.016225:0:6600:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787387659.016239:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4e00/0x93d41aeaa23c7445 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c744c expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.016248:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4e00/0x93d41aeaa23c7445 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c744c expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387659.016256:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787387659.016261:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387659.016267:0:6600:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787387659.016269:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787387659.016295:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.016322:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.016330:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387659.016348:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374175500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655296:0@lo:101: 00000100:00100000:1.0:1787387659.016582:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387659.016618:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754300 going to sleep for 11 seconds 00000100:00100000:0.0:1787387659.016669:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709655296 00000100:00100000:0.0:1787387659.016675:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709655296 00000100:00100000:0.0:1787387659.016711:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787387659.016719:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+10:6600:x1874211709655296:12345-0@lo:101: 00010000:00010000:0.0:1787387659.016728:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387659.016768:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c745a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7453 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.016787:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c745a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7453 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.016810:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c745a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7453 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.016817:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340031000, rc 0) 00000100:00100000:0.0:1787387659.016856:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:6600:x1874211709655296:12345-0@lo:101: Request processed in 137us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387659.016862:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787387659.016962:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374175500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655296:0@lo:101: 00010000:00010000:2.0:1787387659.016974:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.016994:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387659.017108:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655424:0@lo:501: 00000100:00100000:2.0:1787387659.017133:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387659.017151:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4381d69240 going to sleep for 11 seconds 00000100:00100000:0.0:1787387659.017200:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709655424 00000100:00100000:0.0:1787387659.017205:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709655424 00000100:00100000:0.0:1787387659.017235:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787387659.017242:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:6600:x1874211709655424:12345-0@lo:501: 00000100:00100000:0.0:1787387659.017612:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:6600:x1874211709655424:12345-0@lo:501: Request processed in 368us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387659.017618:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787387659.017713:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655424:0@lo:501: 00000100:00100000:3.0:1787387659.017761:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655552:0@lo:503: 00000100:00100000:3.0:1787387659.017804:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387659.017833:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435229d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387659.021571:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709655552 00000100:00100000:0.0:1787387659.021589:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709655552 00000100:00100000:0.0:1787387659.021669:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787387659.021680:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:6600:x1874211709655552:12345-0@lo:503: 00000100:00100000:0.0:1787387659.022001:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:6600:x1874211709655552:12345-0@lo:503: Request processed in 323us (4197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387659.022013:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787387659.022064:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655552:0@lo:503: 00000040:00080000:3.0:1787387659.022420:0:6600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787387659.022520:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655680:0@lo:502: 00000100:00100000:3.0:1787387659.025805:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387659.025874:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435229d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787387659.025993:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709655680 00000100:00100000:2.0:1787387659.026004:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709655680 00000100:00100000:2.0:1787387659.026069:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387659.026079:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:6600:x1874211709655680:12345-0@lo:502: 00000100:00100000:2.0:1787387659.026335:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:6600:x1874211709655680:12345-0@lo:502: Request processed in 257us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387659.026343:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787387659.026506:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655680:0@lo:502: 00000040:00080000:3.0:1787387659.026858:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787387659.026916:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787387659.026952:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787387659.027015:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787387659.027057:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787387659.027095:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787387659.027131:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655808:0@lo:502: 00000100:00100000:3.0:1787387659.027179:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387659.027228:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435229d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787387659.027486:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709655808 00000100:00100000:2.0:1787387659.027492:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709655808 00000100:00100000:2.0:1787387659.027522:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787387659.027530:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:6600:x1874211709655808:12345-0@lo:502: 00000100:00100000:2.0:1787387659.027693:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:6600:x1874211709655808:12345-0@lo:502: Request processed in 163us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387659.027700:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787387659.027773:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655808:0@lo:502: 00000040:00080000:3.0:1787387659.027854:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787387659.027864:0:6600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787387659.029842:0:6620:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787387659.029857:0:6620:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787387659.029865:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387659.029867:0:6620:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787387659.029876:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787387659.029894:0:6620:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d43434ab380) 00000020:00000080:3.0:1787387659.029917:0:6620:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787387659.029923:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787387659.030021:0:6620:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d4379110800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787387659.030030:0:6620:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787387659.030036:0:6620:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x93d41aeaa23c7468 00010000:00010000:2.0:1787387659.038276:0:6620:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787387659.041504:0:6620:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787387659.044702:0:6620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787387659.045036:0:6620:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787387659.059807:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787387659.060349:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787387659.065776:0:6620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787387659.065790:0:6620:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387659.065797:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387659.065800:0:6620:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787387659.065804:0:6620:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387659.065809:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387659.065815:0:6620:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787387659.065820:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787387659.065822:0:6620:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787387659.065885:0:6620:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387659.065889:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387659.065891:0:6620:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787387659.065894:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787387659.067883:0:6600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787387659.067929:0:6600:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787387659.067950:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.067964:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387659.067973:0:6600:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4379110800 from 1 10000000:01000000:2.0:1787387659.067976:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387659.068020:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.068028:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.068039:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387659.068062:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655936:0@lo:101: 00000100:00100000:2.0:1787387659.068138:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387659.068183:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43452e4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787387659.068212:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709655936 00000100:00100000:2.0:1787387659.068219:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709655936 00000100:00100000:2.0:1787387659.068258:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787387659.068267:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:6600:x1874211709655936:12345-0@lo:101: 00010000:00010000:2.0:1787387659.068279:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387659.068292:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43413fde00/0x93d41aeaa23c7476 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c746f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.068330:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43413fde00/0x93d41aeaa23c7476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c746f expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.068341:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43413fde00/0x93d41aeaa23c7476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c746f expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.068351:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fde00, rc 0) 00000100:00100000:2.0:1787387659.068389:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6600:x1874211709655936:12345-0@lo:101: Request processed in 123us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387659.068396:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787387659.068448:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709655936:0@lo:101: 00010000:00010000:2.0:1787387659.068463:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.068471:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387659.068574:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656064:0@lo:501: 00000100:00100000:2.0:1787387659.068599:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387659.068622:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43452e4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787387659.077082:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709656064 00000100:00100000:1.0:1787387659.077103:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709656064 00000100:00100000:1.0:1787387659.077160:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787387659.077170:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6600:x1874211709656064:12345-0@lo:501: 00000100:00100000:1.0:1787387659.077500:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6600:x1874211709656064:12345-0@lo:501: Request processed in 331us (8898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387659.077508:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787387659.077641:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656064:0@lo:501: 00000100:00100000:3.0:1787387659.077695:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656192:0@lo:503: 00000100:00100000:3.0:1787387659.077805:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387659.077836:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435229d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787387659.078141:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709656192 00000100:00100000:2.0:1787387659.078204:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709656192 00000100:00100000:2.0:1787387659.078243:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787387659.078252:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6600:x1874211709656192:12345-0@lo:503: 00000100:00100000:2.0:1787387659.078945:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6600:x1874211709656192:12345-0@lo:503: Request processed in 690us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387659.078955:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787387659.082656:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656192:0@lo:503: 00000040:00080000:3.0:1787387659.083074:0:6600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787387659.083868:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656320:0@lo:502: 00000100:00100000:3.0:1787387659.083945:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387659.083995:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f19b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387659.084059:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709656320 00000100:00100000:1.0:1787387659.084068:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709656320 00000100:00100000:1.0:1787387659.084113:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787387659.084122:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6600:x1874211709656320:12345-0@lo:502: 00000100:00100000:1.0:1787387659.084348:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6600:x1874211709656320:12345-0@lo:502: Request processed in 227us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387659.084356:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787387659.086382:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656320:0@lo:502: 00000040:00080000:3.0:1787387659.088896:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787387659.088997:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787387659.089046:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656448:0@lo:502: 00000100:00100000:3.0:1787387659.089160:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387659.090709:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435229d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787387659.092597:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709656448 00000100:00100000:2.0:1787387659.092613:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709656448 00000100:00100000:2.0:1787387659.092752:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787387659.092763:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6600:x1874211709656448:12345-0@lo:502: 00000100:00100000:2.0:1787387659.093029:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6600:x1874211709656448:12345-0@lo:502: Request processed in 268us (3882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387659.093037:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787387659.093166:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656448:0@lo:502: 00000040:00080000:3.0:1787387659.093319:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787387659.093334:0:6600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787387659.098835:0:6624:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387659.098855:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387659.098857:0:6624:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787387659.098864:0:6624:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4379110800 00000020:00000080:3.0:1787387659.098866:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787387659.098885:0:6624:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387659.098887:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387659.098889:0:6624:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787387659.098892:0:6624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787387659.099045:0:6600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787387659.099075:0:6600:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387659.099138:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.099160:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387659.099201:0:6600:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787387659.099204:0:6600:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d4379110800 10000000:01000000:0.0:1787387659.099207:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d4379110800 10000000:01000000:0.0:1787387659.099211:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787387659.099216:0:6600:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4379110800 from 1 10000000:01000000:0.0:1787387659.099218:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787387659.099251:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.099259:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.099270:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387659.099292:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656576:0@lo:101: 00000100:00100000:0.0:1787387659.099355:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387659.099412:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a2a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387659.099543:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709656576 00000100:00100000:1.0:1787387659.099551:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709656576 00000100:00100000:1.0:1787387659.099598:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787387659.099607:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:6600:x1874211709656576:12345-0@lo:101: 00010000:00010000:1.0:1787387659.099637:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387659.099651:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7484 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c747d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.099672:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c747d expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.099683:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c747d expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.099692:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4800, rc 0) 00000100:00100000:1.0:1787387659.099734:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6600:x1874211709656576:12345-0@lo:101: Request processed in 128us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387659.099763:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787387659.099957:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656576:0@lo:101: 00010000:00010000:0.0:1787387659.099971:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.099979:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387659.100068:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656704:0@lo:501: 00000100:00100000:0.0:1787387659.100092:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387659.100113:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a2a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387659.100160:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709656704 00000100:00100000:3.0:1787387659.100165:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709656704 00000100:00100000:3.0:1787387659.100192:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787387659.100198:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6600:x1874211709656704:12345-0@lo:501: 00000100:00100000:3.0:1787387659.101230:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6600:x1874211709656704:12345-0@lo:501: Request processed in 1028us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387659.101240:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787387659.103035:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656704:0@lo:501: 00000100:00100000:0.0:1787387659.103094:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656832:0@lo:503: 00000100:00100000:0.0:1787387659.103253:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387659.103982:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a2a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387659.105396:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709656832 00000100:00100000:3.0:1787387659.105409:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709656832 00000100:00100000:3.0:1787387659.105538:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787387659.105551:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6600:x1874211709656832:12345-0@lo:503: 00000100:00100000:0.0:1787387659.105943:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656832:0@lo:503: 00000040:00080000:0.0:1787387659.106305:0:6600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787387659.106389:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656960:0@lo:502: 00000100:00100000:0.0:1787387659.106430:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387659.106454:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6600:x1874211709656832:12345-0@lo:503: Request processed in 906us (3201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387659.106462:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787387659.107013:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4377f64600 going to sleep for 11 seconds 00000100:00100000:3.0:1787387659.107118:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709656960 00000100:00100000:3.0:1787387659.107128:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709656960 00000100:00100000:3.0:1787387659.107169:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787387659.107235:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6600:x1874211709656960:12345-0@lo:502: 00000100:00100000:3.0:1787387659.107437:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6600:x1874211709656960:12345-0@lo:502: Request processed in 261us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387659.107443:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787387659.107567:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709656960:0@lo:502: 00000040:00080000:0.0:1787387659.108428:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787387659.108486:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787387659.108530:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787387659.108574:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787387659.108607:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787387659.108669:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787387659.108895:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787387659.108929:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787387659.108972:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787387659.109003:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787387659.109033:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787387659.109086:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787387659.109119:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787387659.109160:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787387659.109205:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787387659.109236:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787387659.109265:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787387659.109318:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787387659.109352:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787387659.109381:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787387659.109434:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787387659.109469:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787387659.109498:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787387659.109556:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787387659.109588:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787387659.109617:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787387659.109674:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787387659.109706:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787387659.109775:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709657088:0@lo:502: 00000100:00100000:0.0:1787387659.109845:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387659.109871:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4377f64600 going to sleep for 11 seconds 00000100:00100000:3.0:1787387659.110197:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709657088 00000100:00100000:3.0:1787387659.110205:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709657088 00000100:00100000:3.0:1787387659.110243:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787387659.110251:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6600:x1874211709657088:12345-0@lo:502: 00000100:00100000:3.0:1787387659.110442:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6600:x1874211709657088:12345-0@lo:502: Request processed in 191us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387659.110449:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787387659.110697:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709657088:0@lo:502: 00000040:00080000:0.0:1787387659.110811:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787387659.110823:0:6600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787387659.111534:0:6625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787387659.111550:0:6625:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d4343528000) 00000020:00000080:2.0:1787387659.111570:0:6625:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787387659.111773:0:6625:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d4379110800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787387659.111778:0:6625:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4379110800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787387659.111781:0:6625:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4379110800 3 00010000:00080000:2.0:1787387659.111815:0:6625:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4377f7b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.159@tcp at head 00010000:00010000:2.0:1787387659.113924:0:6625:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787387659.114039:0:6625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787387659.114077:0:6625:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787387659.114091:0:6625:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x93d41aeaa23c7492 00000100:00080000:2.0:1787387659.114102:0:6625:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387659.114108:0:6625:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d4377f7b800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1787387659.114145:0:6625:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4343524700 x1874211709657216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387659.114178:0:6625:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787387659.116736:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874211709657216:0@lo:38: 00000100:00100000:0.0:1787387659.116823:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387659.116889:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387659.116898:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709657344:0@lo:400: 00000100:00100000:0.0:1787387659.116921:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387659.116952:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709657216 00000100:00100000:0.0:1787387659.116958:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709657216 00000100:00100000:0.0:1787387659.116985:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709657344 00000100:00100000:0.0:1787387659.116987:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709657344 00000100:00100000:0.0:1787387659.117011:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387659.117018:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709657344:12345-0@lo:400: 00000100:00100000:0.0:1787387659.117068:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709657344:12345-0@lo:400: Request processed in 49us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387659.117075:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387659.117090:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387659.117095:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874211709657216:12345-0@lo:38: 00010000:00080000:0.0:1787387659.117115:0:5809:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:0.0:1787387659.117160:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x93d41aeaa23c7499 00000004:00100000:0.0:1787387659.117175:0:5809:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787387659.117206:0:5809:0:(import.c:65:import_set_state_nolock()) ffff8d4377c95800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387659.117239:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874211709657216:12345-0@lo:38: Request processed in 142us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387659.117245:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787387659.117285:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d4343527480 x1874211709657344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387659.117299:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709657344:0@lo:400: 00010000:00080000:0.0:1787387659.117327:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d4343524700 x1874211709657216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387659.117334:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787387659.117346:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787387659.117353:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787387659.117358:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787387659.117360:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4377f7b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787387659.117365:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874211709657216:0@lo:38: 00000040:00080000:2.0:1787387659.129134:0:6625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787387659.129400:0:6600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787387659.129431:0:6600:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787387659.129454:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.129466:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787387659.129509:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787387659.129511:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387659.129512:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387659.129513:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387659.129515:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387659.129516:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387659.129517:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387659.129519:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387659.129520:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387659.129521:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387659.129526:0:6600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787387659.129530:0:6600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787387659.129533:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787387659.129534:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387659.129535:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387659.129536:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387659.129537:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387659.129538:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387659.129539:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387659.129540:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387659.129540:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387659.129541:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387659.129542:0:6600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787387659.129565:0:6600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787387659.129583:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709657472:0@lo:253: 00000100:00100000:1.0:1787387659.129660:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387659.129704:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43517540c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387659.130459:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709657472 00000100:00100000:3.0:1787387659.130468:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709657472 00000100:00100000:3.0:1787387659.130525:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787387659.130535:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6600:x1874211709657472:12345-0@lo:253: 20000000:01000000:3.0:1787387659.130571:0:5801:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787387659.130585:0:5801:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787387659.162398:0:5801:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787387659.162418:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787387659.163008:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787387659.163014:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787387659.163039:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.163059:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c73f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c73f1 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.163067:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.163105:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c73f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c73f1 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387659.163118:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c73f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c73f1 expref: 13 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387659.163133:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1874211709657600:0@lo:104: 00000100:00100000:0.0:1787387659.163270:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387659.163323:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4377f64600 going to sleep for 11 seconds 00000100:00100000:2.0:1787387659.163379:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709657600 00000100:00100000:2.0:1787387659.163386:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709657600 00000100:00100000:2.0:1787387659.163428:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787387659.163437:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:5823:x1874211709657600:12345-0@lo:104: 00010000:00010000:2.0:1787387659.163463:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4340031e00/0x93d41aeaa23c73f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.163536:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387659.163543:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:5823:x1874211709657600:12345-0@lo:104: Request processed in 107us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387659.163550:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787387659.163612:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387659.163618:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4340031e00/0x93d41aeaa23c73f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.163635:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340031e00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387659.163638:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4340031e00/0x93d41aeaa23c73f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.163647:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4340031e00/0x93d41aeaa23c73f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387659.163654:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4340031e00/0x93d41aeaa23c73f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387659.163659:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387659.163698:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4340031e00/0x93d41aeaa23c73f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.163704:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387659.163719:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4340031e00/0x93d41aeaa23c73f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.163725:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4340031e00/0x93d41aeaa23c73f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c73f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.163764:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387659.163766:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387659.163768:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387659.164623:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1874211709657600:0@lo:104: 00010000:00010000:0.0:1787387659.164656:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387659.164683:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709657728:0@lo:103: 00000100:00100000:0.0:1787387659.164771:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387659.164966:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709657728 00000100:00100000:2.0:1787387659.164972:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709657728 00010000:00010000:2.0:1787387659.164998:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c73f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c73f1 expref: 14 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387659.165032:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787387659.165040:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434643e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:3311:x1874211709657728:12345-0@lo:103: 00010000:00010000:2.0:1787387659.165052:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387659.165057:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c73f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c73f1 expref: 14 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.165068:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c73f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c73f1 expref: 14 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.165085:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c73f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c73f1 expref: 14 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.165099:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.165107:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787387659.165132:0:5793:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009967124s 00010000:00010000:2.0:1787387659.165137:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.165144:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.165297:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.165303:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.165309:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030a00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387659.165313:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.165321:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387659.168898:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6600:x1874211709657472:12345-0@lo:253: Request processed in 38357us (39230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387659.168913:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1787387659.169134:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387659.169266:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387659.169310:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434643e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:3311:x1874211709657728:12345-0@lo:103: Request processed in 4270us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387659.169318:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787387659.169426:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709657728:0@lo:103: 00010000:00010000:1.0:1787387659.169485:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.169494:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387659.169500:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c74a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387659.169607:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6600:1874211709657472:0@lo:253: 10000000:01000000:1.0:1787387659.169619:0:6600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787387659.169623:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787387659.169634:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387659.169636:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387659.169637:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387659.169638:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387659.169639:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387659.169641:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387659.169642:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387659.169644:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387659.169664:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387659.169665:0:6600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787387659.169682:0:6600:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787387659.179292:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787387659.179475:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787387659.179709:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787387659.179907:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787387659.180113:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787387659.180305:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787387659.181361:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787387659.463787:0:6600:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787387659.463796:0:6600:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787387659.463827:0:6600:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787387659.463890:0:6600:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787387659.463906:0:6600:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787387659.463931:0:6600:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787387659.614795:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387660.643997:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387661.662026:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387662.686193:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387663.719683:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787387664.479595:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787387664.479602:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4350ce4000 from 21 10000000:01000000:1.0:1787387664.479608:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387664.479643:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387664.479654:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387664.479665:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387664.479686:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709657984:0@lo:101: 00000100:00100000:1.0:1787387664.479780:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387664.479822:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373aa4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387664.479903:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709657984 00000100:00100000:3.0:1787387664.479911:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709657984 00000100:00100000:3.0:1787387664.479957:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787387664.479965:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5804:x1874211709657984:12345-0@lo:101: 00010000:00010000:3.0:1787387664.479980:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387664.479992:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c74ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c74a7 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.480035:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c74ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c74a7 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.480046:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c74ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c74a7 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.480055:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152ec00, rc 0) 00000100:00100000:3.0:1787387664.480092:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:5804:x1874211709657984:12345-0@lo:101: Request processed in 128us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387664.480098:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787387664.480321:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709657984:0@lo:101: 00010000:00010000:1.0:1787387664.480342:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387664.480351:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387664.480400:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709658112:0@lo:501: 00000100:00100000:1.0:1787387664.480435:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387664.487467:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387664.487507:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709657856:0@lo:400: 00000100:00100000:2.0:1787387664.487591:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387664.491817:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373aa4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387664.495875:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709658240:0@lo:400: 00000100:00100000:3.0:1787387664.495947:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387664.495997:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387664.496003:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709658368:0@lo:400: 00000100:00100000:3.0:1787387664.496029:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387664.496063:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709658240 00000100:00100000:3.0:1787387664.496070:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709658240 00000100:00100000:3.0:1787387664.496110:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709658368 00000100:00100000:3.0:1787387664.496113:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709658368 00000100:00100000:2.0:1787387664.496762:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387664.496775:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709658240:12345-0@lo:400: 00000100:00100000:3.0:1787387664.496827:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787387664.496835:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709658240:12345-0@lo:400: Request processed in 63us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387664.496836:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787387664.496845:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387664.496865:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387664.496872:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709658368:12345-0@lo:400: 00000100:00100000:2.0:1787387664.496904:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709658368:12345-0@lo:400: Request processed in 32us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387664.496909:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387664.496939:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709658112 00010000:00080000:3.0:1787387664.496944:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4345dced80 x1874211709658368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387664.496945:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709658112 00000100:00100000:3.0:1787387664.496960:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709658368:0@lo:400: 00000100:00100000:2.0:1787387664.496974:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709657856 00010000:00080000:3.0:1787387664.496975:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4345dcf480 x1874211709658240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387664.496978:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709657856 00000100:00100000:3.0:1787387664.496987:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709658240:0@lo:400: 00000100:00100000:2.0:1787387664.496995:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787387664.497005:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709658112:12345-0@lo:501: 00000100:00100000:2.0:1787387664.497284:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709658112:12345-0@lo:501: Request processed in 281us (16847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387664.497291:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787387664.497314:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787387664.497321:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:3311:x1874211709657856:12345-0@lo:400: 00000100:00100000:2.0:1787387664.497350:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:3311:x1874211709657856:12345-0@lo:400: Request processed in 30us (9759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387664.497357:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787387664.497397:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709657856:0@lo:400: 00000100:00100000:3.0:1787387664.497534:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709658112:0@lo:501: 00000100:00100000:3.0:1787387664.497574:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709658496:0@lo:503: 00000100:00100000:3.0:1787387664.497884:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387664.497900:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43742a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387664.498425:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709658496 00000100:00100000:2.0:1787387664.498433:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709658496 00000100:00100000:2.0:1787387664.498467:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787387664.498561:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:5804:x1874211709658496:12345-0@lo:503: 00000100:00100000:2.0:1787387664.498768:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:5804:x1874211709658496:12345-0@lo:503: Request processed in 293us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387664.498775:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787387664.498818:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709658496:0@lo:503: 00000100:00080000:1.0:1787387664.499102:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387664.503211:0:6841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6841:1874211709658624:0@lo:502: 00000100:00100000:2.0:1787387664.503299:0:6841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387664.503339:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709658624 00000100:00100000:2.0:1787387664.503346:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709658624 00000100:00100000:2.0:1787387664.503396:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787387664.503405:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6841:x1874211709658624:12345-0@lo:502: 00000100:00100000:2.0:1787387664.507027:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6841:x1874211709658624:12345-0@lo:502: Request processed in 3611us (3716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387664.507060:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787387664.507161:0:6841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347c606c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387664.507192:0:6841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6841:1874211709658624:0@lo:502: 00000100:00100000:2.0:1787387664.507277:0:6841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6841:1874211709658752:0@lo:502: 00000100:00100000:2.0:1787387664.507331:0:6841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387664.507362:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709658752 00000100:00100000:2.0:1787387664.507369:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709658752 00000100:00100000:2.0:1787387664.507406:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787387664.507414:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6841:x1874211709658752:12345-0@lo:502: 00000100:00100000:2.0:1787387664.507881:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:6841:x1874211709658752:12345-0@lo:502: Request processed in 467us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387664.507888:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787387664.507921:0:6841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347c606c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387664.507934:0:6841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6841:1874211709658752:0@lo:502: 00000040:00080000:2.0:1787387664.507954:0:6841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787387664.510983:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787387664.511015:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787387664.511026:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.511038:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387664.511048:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787387664.511050:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4350ce4000 from 4 10000000:01000000:3.0:1787387664.511053:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787387664.511094:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.511102:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.511113:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387664.511143:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709658880:0@lo:101: 00000100:00100000:3.0:1787387664.511199:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387664.511229:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387664.511250:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709658880 00000100:00100000:3.0:1787387664.511255:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709658880 00000100:00100000:3.0:1787387664.511299:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787387664.511305:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:5804:x1874211709658880:12345-0@lo:101: 00010000:00010000:3.0:1787387664.511317:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387664.511329:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c74bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c74b5 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.511349:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c74bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c74b5 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.511358:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c74bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c74b5 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.511366:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f400, rc 0) 00000100:00100000:3.0:1787387664.511396:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709658880:12345-0@lo:101: Request processed in 91us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387664.511402:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787387664.511453:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709658880:0@lo:101: 00010000:00010000:3.0:1787387664.511464:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.511472:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387664.511509:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709659008:0@lo:256: 00000100:00100000:3.0:1787387664.511547:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387664.511557:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387664.511566:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709659008 00000100:00100000:3.0:1787387664.511569:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709659008 00000100:00100000:3.0:1787387664.511598:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787387664.511609:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709659008:12345-0@lo:256: 20000000:01000000:3.0:1787387664.511621:0:5802:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787387664.511634:0:5802:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787387664.511637:0:5802:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787387664.512354:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709659008:12345-0@lo:256: Request processed in 742us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387664.512362:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787387664.512406:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709659008:0@lo:256: 10000000:01000000:3.0:1787387664.512463:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787387664.512470:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.512479:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387664.512486:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787387664.512489:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787387664.512491:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787387664.512511:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.512518:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.512537:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387664.512550:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709659136:0@lo:101: 00000100:00100000:3.0:1787387664.512575:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387664.512999:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387664.513017:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709659136 00000100:00100000:3.0:1787387664.513021:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709659136 00000100:00100000:3.0:1787387664.513045:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787387664.513051:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709659136:12345-0@lo:101: 00010000:00010000:3.0:1787387664.513059:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387664.513070:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152e000/0x93d41aeaa23c74ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c74c3 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.513086:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152e000/0x93d41aeaa23c74ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c74c3 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.513095:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152e000/0x93d41aeaa23c74ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c74c3 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.513102:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e000, rc 0) 00000100:00100000:3.0:1787387664.513126:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709659136:12345-0@lo:101: Request processed in 76us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387664.513243:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787387664.513279:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709659136:0@lo:101: 00010000:00010000:3.0:1787387664.513291:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387664.513299:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387664.513343:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709659264:0@lo:501: 00000100:00100000:3.0:1787387664.513365:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387664.513376:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387664.513391:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709659264 00000100:00100000:3.0:1787387664.513395:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709659264 00000100:00100000:3.0:1787387664.513412:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787387664.513416:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709659264:12345-0@lo:501: 00000100:00100000:3.0:1787387664.513933:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709659264:12345-0@lo:501: Request processed in 514us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387664.513940:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787387664.513968:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709659264:0@lo:501: 00000100:00100000:3.0:1787387664.513990:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709659392:0@lo:503: 00000100:00100000:3.0:1787387664.514021:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387664.514032:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4381d69a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787387664.514041:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709659392 00000100:00100000:3.0:1787387664.514044:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709659392 00000100:00100000:3.0:1787387664.514060:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787387664.514065:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709659392:12345-0@lo:503: 00000100:00100000:3.0:1787387664.514344:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709659392:12345-0@lo:503: Request processed in 278us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387664.514351:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787387664.514384:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709659392:0@lo:503: 00000100:00100000:0.0:1787387664.516023:0:6842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6842:1874211709659520:0@lo:502: 00000100:00100000:0.0:1787387664.516163:0:6842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387664.516195:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709659520 00000100:00100000:0.0:1787387664.516202:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709659520 00000100:00100000:0.0:1787387664.516237:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787387664.516245:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434657a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:6842:x1874211709659520:12345-0@lo:502: 00000100:00100000:0.0:1787387664.517803:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434657a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:6842:x1874211709659520:12345-0@lo:502: Request processed in 1549us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387664.517817:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787387664.517903:0:6842:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387664.517929:0:6842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6842:1874211709659520:0@lo:502: 00000020:01000000:0.0:1787387664.517968:0:6842:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787387664.517976:0:6842:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787387664.517983:0:6842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387664.517985:0:6842:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787387664.517992:0:6842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787387664.517996:0:6842:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:0.0:1787387664.518033:0:6842:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787387664.520010:0:6842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787387664.520775:0:6842:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d4242c98000) 00000020:00000080:0.0:1787387664.520799:0:6842:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787387664.520814:0:6842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787387664.520904:0:6842:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787387664.520910:0:6842:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787387664.520919:0:6842:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c74d8 00010000:00080000:0.0:1787387664.520952:0:6842:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4373f2f000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1787387664.521874:0:6842:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787387664.633310:0:6842:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787387664.633337:0:6842:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787387664.634243:0:6842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387664.634405:0:6842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387664.634649:0:6842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787387664.634713:0:6842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787387664.641024:0:6857:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787387664.641034:0:6857:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787387664.644208:0:6842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787387664.644224:0:6842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787387664.644260:0:6842:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787387664.644284:0:6842:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x93d41aeaa23c74df 00000100:00080000:2.0:1787387664.644294:0:6842:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387664.644300:0:6842:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d4373f2f000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1787387664.644337:0:6842:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4343524a80 x1874211709659648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387664.644361:0:6842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787387664.644819:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709659904:0@lo:400: 00000100:00100000:3.0:1787387664.644845:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709660032:0@lo:400: 00000100:00100000:0.0:1787387664.644888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387664.644939:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387664.644945:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387664.644953:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709659776:0@lo:400: 00000100:00100000:0.0:1787387664.644980:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387664.645011:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709659776 00000100:00100000:0.0:1787387664.645018:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709659776 00000100:00100000:0.0:1787387664.645057:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787387664.645064:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:3312:x1874211709659776:12345-0@lo:400: 00000100:00100000:0.0:1787387664.645108:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:3312:x1874211709659776:12345-0@lo:400: Request processed in 44us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387664.645115:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787387664.645154:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709659776:0@lo:400: 00000100:00100000:0.0:1787387664.645924:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709659904 00000100:00100000:0.0:1787387664.645932:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709659904 00000100:00100000:0.0:1787387664.646034:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709660032 00000100:00100000:0.0:1787387664.646038:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709660032 00000100:00100000:0.0:1787387664.646059:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787387664.646074:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709659904:12345-0@lo:400: 00000020:01000000:2.0:1787387664.646114:0:6842:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387664.646122:0:6842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387664.646125:0:6842:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787387664.646129:0:6842:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387664.646133:0:6842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387664.646137:0:6842:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000100:00100000:0.0:1787387664.646137:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709659904:12345-0@lo:400: Request processed in 63us (1248us total) trans 0 rc 0/0 00000020:00000080:2.0:1787387664.646141:0:6842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787387664.646145:0:6842:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787387664.646149:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787387664.646165:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387664.646172:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709660032:12345-0@lo:400: 00000100:00100000:2.0:1787387664.646180:0:6842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343526d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6842:1874211709660160:0@lo:502: 00000100:00100000:0.0:1787387664.646205:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709660032:12345-0@lo:400: Request processed in 34us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387664.646212:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787387664.646236:0:6842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387664.646240:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709659648:0@lo:8: 00000100:00100000:2.0:1787387664.646268:0:6842:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373f1b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787387664.646277:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387664.646294:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709660160 00000100:00100000:2.0:1787387664.646298:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709660160 00000100:00100000:2.0:1787387664.646333:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787387664.646334:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709659648 00000100:00100000:0.0:1787387664.646339:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709659648 00000100:00100000:2.0:1787387664.646343:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434657b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:6842:x1874211709660160:12345-0@lo:502: 00000100:00100000:0.0:1787387664.646364:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387664.646370:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874211709659648:12345-0@lo:8: 00010000:00080000:0.0:1787387664.646392:0:6604:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:0.0:1787387664.646421:0:6604:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x93d41aeaa23c74e6 00002000:00100000:0.0:1787387664.646458:0:6604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d4373f28000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787387664.646463:0:6604:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787387664.646466:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787387664.646606:0:6604:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787387664.646736:0:6604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787387664.646801:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d4242d48800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387664.646843:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874211709659648:12345-0@lo:8: Request processed in 471us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387664.646849:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787387664.646892:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4343524a80 x1874211709659648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387664.646903:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787387664.646910:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787387664.646918:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787387664.646924:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787387664.646926:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4373f2f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787387664.646938:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787387664.646944:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709659648:0@lo:8: 00010000:00080000:0.0:1787387664.646978:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4345dcd880 x1874211709659904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387664.646989:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709659904:0@lo:400: 00000100:00100000:2.0:1787387664.647045:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434657b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:6842:x1874211709660160:12345-0@lo:502: Request processed in 704us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387664.647052:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787387664.647127:0:6842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343526d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:6842:1874211709660160:0@lo:502: 00000020:01000000:0.0:1787387664.647152:0:6842:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387664.647157:0:6842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387664.647159:0:6842:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787387664.647164:0:6842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00010000:00080000:3.0:1787387664.647182:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4345dcdf80 x1874211709660032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387664.647195:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709660032:0@lo:400: 00000004:00080000:3.0:1787387664.647235:0:6857:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:0.0:1787387664.647273:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787387664.647294:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787387664.647305:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387664.647315:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387664.647327:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787387664.647330:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d43434a99c0 from 1 10000000:01000000:0.0:1787387664.647333:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000004:00080000:3.0:1787387664.647341:0:6857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 169096601344ns, next at 0ns, rc = 0 00010000:00010000:0.0:1787387664.647372:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387664.647382:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387664.647392:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387664.647409:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709660288:0@lo:101: 00000100:00100000:0.0:1787387664.647437:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387664.647465:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347d3e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787387664.648056:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709660288 00000100:00100000:2.0:1787387664.648064:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709660288 00000100:00100000:2.0:1787387664.648097:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787387664.648104:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709660288:12345-0@lo:101: 00010000:00010000:2.0:1787387664.648113:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387664.648127:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c74f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c74ed expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387664.648149:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c74f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c74ed expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387664.648159:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c74f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c74ed expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387664.648168:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fda00, rc 0) 00000100:00100000:2.0:1787387664.648206:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709660288:12345-0@lo:101: Request processed in 103us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387664.648212:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787387664.650861:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709660288:0@lo:101: 00010000:00010000:0.0:1787387664.650887:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387664.650899:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387664.650974:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709660416:0@lo:501: 00000100:00100000:0.0:1787387664.651033:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387664.651082:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347d3e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787387664.651168:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709660416 00000100:00100000:1.0:1787387664.651176:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709660416 00000100:00100000:1.0:1787387664.651219:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787387664.651230:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709660416:12345-0@lo:501: 00000100:00100000:1.0:1787387664.651498:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709660416:12345-0@lo:501: Request processed in 270us (464us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787387664.651533:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787387664.652074:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709660416:0@lo:501: 10000000:01000000:0.0:1787387664.652109:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787387664.652117:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387664.652128:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387664.733838:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787387664.737806:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787387664.808655:0:6858:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787387664.808687:0:6858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6858:1874211709660672:0@lo:7: 00000100:00100000:1.0:1787387664.808772:0:6858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387664.808815:0:6858:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373aa4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787387664.808846:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709660544:0@lo:13: 00000100:00100000:1.0:1787387664.808866:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387664.808906:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709660672 00000100:00100000:1.0:1787387664.808913:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709660672 00000100:00100000:1.0:1787387664.808958:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387664.808966:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6858:x1874211709660672:12345-0@lo:7: 00000100:00080000:3.0:1787387664.809816:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387664.809839:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709660544 00000100:00100000:3.0:1787387664.809845:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709660544 00000100:00100000:3.0:1787387664.809878:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387664.809886:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874211709660544:12345-0@lo:13: 00002000:00000024:3.0:1787387664.809916:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787387664.809991:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874211709660544:12345-0@lo:13: Request processed in 105us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387664.809998:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787387664.823134:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4374177480 x1874211709660544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387664.823161:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709660544:0@lo:13: 00002000:00080000:2.0:1787387664.836731:0:6606:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787387664.836932:0:6606:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787387664.838773:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6858:x1874211709660672:12345-0@lo:7: Request processed in 29801us (29995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387664.838791:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787387664.838897:0:6858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4374176d80 x1874211709660672/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787387680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387664.838912:0:6858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6858:1874211709660672:0@lo:7: 00000004:00080000:1.0:1787387664.838925:0:6858:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787387664.838974:0:6858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6858:1874211709660800:0@lo:5: 00000100:00100000:1.0:1787387664.839007:0:6858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387664.839056:0:6858:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373aa4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787387664.839346:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709660800 00000100:00100000:2.0:1787387664.839353:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709660800 00000100:00100000:2.0:1787387664.839393:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387664.839402:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6858:x1874211709660800:12345-0@lo:5: 00002000:00080000:2.0:1787387664.839594:0:6605:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787387664.839599:0:6605:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787387664.839914:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6858:x1874211709660800:12345-0@lo:5: Request processed in 511us (905us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787387664.839921:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787387664.845621:0:6858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4374176d80 x1874211709660800/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387664.845643:0:6858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6858:1874211709660800:0@lo:5: 00000004:00080000:1.0:1787387664.845657:0:6858:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787387664.845697:0:6858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374175f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6858:1874211709660928:0@lo:700: 00000100:00100000:1.0:1787387664.845764:0:6858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387664.845799:0:6858:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373aa4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787387664.845824:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709660928 00000100:00100000:1.0:1787387664.845830:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709660928 00000100:00100000:1.0:1787387664.845871:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387664.845880:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6858:x1874211709660928:12345-0@lo:700: 00000100:00100000:1.0:1787387664.845914:0:6612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6612:1874211709661056:0@lo:700: 00000100:00100000:1.0:1787387664.845960:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387664.845976:0:6612:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373aa4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787387664.845996:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709661056 00000100:00100000:1.0:1787387664.845999:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709661056 00000100:00100000:1.0:1787387664.846024:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387664.846030:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6612:x1874211709661056:12345-0@lo:700: 40000000:02000000:1.0:1787387664.874261:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787387664.888187:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6612:x1874211709661056:12345-0@lo:700: Request processed in 42147us (42216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387664.888206:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787387664.889208:0:6612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4374176680 x1874211709661056/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787387680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387664.889227:0:6612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6612:1874211709661056:0@lo:700: 40000000:02000000:1.0:1787387664.889240:0:6612:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:2.0:1787387665.066667:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787387665.066710:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1787387665.067046:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6858:x1874211709660928:12345-0@lo:700: Request processed in 221162us (221277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387665.067062:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787387665.069579:0:6858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4374175f80 x1874211709660928/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787387680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387665.069767:0:6858:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787387665.069788:0:6858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374175f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6858:1874211709660928:0@lo:700: 00000004:02000040:2.0:1787387665.181338:0:6858:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787387665.203306:0:6858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6858:1874211709661184:0@lo:5: 00000100:00100000:0.0:1787387665.203378:0:6858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387665.203447:0:6858:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a2a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787387665.213766:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709661184 00000100:00100000:3.0:1787387665.213780:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709661184 00000100:00100000:3.0:1787387665.217712:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787387665.217724:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6858:x1874211709661184:12345-0@lo:5: 00002000:00080000:1.0:1787387665.238106:0:6606:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787387665.238128:0:6606:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787387665.244350:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6858:x1874211709661184:12345-0@lo:5: Request processed in 26619us (40963us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787387665.244364:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787387665.244381:0:6858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d43747ca300 x1874211709661184/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387681 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387665.244401:0:6858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6858:1874211709661184:0@lo:5: 00000004:00080000:0.0:1787387665.244433:0:6858:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787387665.768635:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387666.783818:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787387667.329834:0:6978:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787387667.809896:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387668.829819:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387669.855461:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387670.109983:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709661440:0@lo:400: 00000100:00100000:3.0:1787387670.109992:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709661568:0@lo:400: 00000100:00100000:0.0:1787387670.110102:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709661312:0@lo:400: 00000100:00100000:2.0:1787387670.110207:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709661696:0@lo:400: 00000100:00100000:3.0:1787387670.110421:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387670.110534:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709661568 00000100:00100000:3.0:1787387670.110542:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709661568 00000100:00100000:3.0:1787387670.110599:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387670.110608:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709661568:12345-0@lo:400: 00000100:00100000:3.0:1787387670.110659:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709661568:12345-0@lo:400: Request processed in 52us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387670.110683:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787387670.110731:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787387670.110776:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4345dcc700 x1874211709661568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387670.110789:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709661568:0@lo:400: 00000100:00100000:1.0:1787387670.111266:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387670.111289:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387670.111297:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709661824:0@lo:13: 00000100:00100000:1.0:1787387670.111329:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387670.111377:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709661824 00000100:00100000:1.0:1787387670.111382:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709661824 00000100:00100000:1.0:1787387670.111425:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387670.111432:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709661824:12345-0@lo:13: 00002000:00000024:1.0:1787387670.111456:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387670.111491:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709661824:12345-0@lo:13: Request processed in 60us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387670.111498:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787387670.111714:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787387670.113614:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4345dcfb80 x1874211709661824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387670.113640:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709661824:0@lo:13: 00000100:00100000:3.0:1787387670.113998:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709661440 00000100:00100000:3.0:1787387670.114006:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709661440 00000100:00100000:3.0:1787387670.114049:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387670.114369:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709661440:12345-0@lo:400: 00000100:00100000:3.0:1787387670.114455:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709661440:12345-0@lo:400: Request processed in 89us (3189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387670.114461:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787387670.115689:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4345dcd180 x1874211709661440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387670.115704:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709661440:0@lo:400: 00000100:00100000:0.0:1787387670.117126:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387670.117169:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709661312 00000100:00100000:0.0:1787387670.117177:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709661312 00000100:00100000:0.0:1787387670.117218:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787387670.117228:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:3311:x1874211709661312:12345-0@lo:400: 00000100:00100000:0.0:1787387670.117276:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:3311:x1874211709661312:12345-0@lo:400: Request processed in 50us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387670.117281:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787387670.117338:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709661312:0@lo:400: 00000100:00100000:2.0:1787387670.121881:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387670.121937:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709661696 00000100:00100000:2.0:1787387670.121944:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709661696 00000100:00100000:2.0:1787387670.121991:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387670.122000:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709661696:12345-0@lo:400: 00000100:00100000:2.0:1787387670.122072:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709661696:12345-0@lo:400: Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387670.122079:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787387670.122119:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4345dcca80 x1874211709661696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387670.122133:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709661696:0@lo:400: 00000001:00080000:1.0:1787387670.224229:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787387670.883802:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387671.905856:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387672.930057:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387673.955932:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387674.976869:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387675.234595:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387675.234619:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709661952:0@lo:13: 00000100:00100000:2.0:1787387675.234705:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387675.234800:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709661952 00000100:00100000:2.0:1787387675.234808:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709661952 00000100:00100000:2.0:1787387675.234866:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387675.234874:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709661952:12345-0@lo:13: 00002000:00000024:2.0:1787387675.234908:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387675.234954:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709661952:12345-0@lo:13: Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387675.234961:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787387675.234980:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787387675.235009:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4343527100 x1874211709661952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387675.235020:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787387675.235053:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709661952:0@lo:13: 00000100:00100000:1.0:1787387675.243757:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387675.243787:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709662336:0@lo:400: 00000100:00100000:1.0:1787387675.243852:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387675.243905:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709662336 00000100:00100000:1.0:1787387675.243913:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709662336 00000100:00100000:1.0:1787387675.243973:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787387675.243983:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709662336:12345-0@lo:400: 00000100:00100000:1.0:1787387675.244038:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709662336:12345-0@lo:400: Request processed in 57us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387675.244046:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787387675.244088:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4374176a00 x1874211709662336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387675.244102:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709662336:0@lo:400: 00000100:00100000:2.0:1787387675.244924:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709662208:0@lo:400: 00000100:00100000:2.0:1787387675.244968:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387675.244994:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387675.245000:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709662080:0@lo:400: 00000100:00100000:2.0:1787387675.245026:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787387675.245063:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387675.245074:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709662208 00000100:00100000:2.0:1787387675.245079:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709662208 00000100:00100000:2.0:1787387675.245111:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387675.245118:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709662208:12345-0@lo:400: 00000100:00100000:2.0:1787387675.245156:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709662208:12345-0@lo:400: Request processed in 39us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387675.245162:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387675.245181:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709662080 00000100:00100000:2.0:1787387675.245187:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709662080 00000100:00100000:2.0:1787387675.245226:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787387675.245233:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:3314:x1874211709662080:12345-0@lo:400: 00000100:00100000:2.0:1787387675.245264:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:3314:x1874211709662080:12345-0@lo:400: Request processed in 31us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387675.245270:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787387675.245307:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709662080:0@lo:400: 00010000:00080000:2.0:1787387675.245333:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4374177480 x1874211709662208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387675.245344:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709662208:0@lo:400: 00010000:00010000:1.0:1787387675.997952:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387677.023926:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387678.051875:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387679.069901:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387680.095088:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387680.352054:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709662592:0@lo:400: 00000100:00100000:1.0:1787387680.352140:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387680.352224:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387680.352230:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709662720:0@lo:400: 00000100:00100000:1.0:1787387680.352253:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387680.352289:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709662592 00000100:00100000:1.0:1787387680.352295:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709662592 00000100:00100000:1.0:1787387680.352331:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709662720 00000100:00100000:1.0:1787387680.352333:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709662720 00000100:00100000:1.0:1787387680.352358:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787387680.352365:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709662592:12345-0@lo:400: 00000100:00100000:1.0:1787387680.352409:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709662592:12345-0@lo:400: Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387680.352415:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787387680.352429:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787387680.352434:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709662720:12345-0@lo:400: 00000100:00100000:1.0:1787387680.352455:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709662720:12345-0@lo:400: Request processed in 21us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387680.352460:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787387680.352490:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4374175500 x1874211709662720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387680.352502:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709662720:0@lo:400: 00010000:00080000:1.0:1787387680.352511:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4374174a80 x1874211709662592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387680.352518:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709662592:0@lo:400: 00000100:00100000:0.0:1787387680.352809:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709662848:0@lo:400: 00000100:00100000:0.0:1787387680.352840:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387680.352878:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387680.352884:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709662464:0@lo:400: 00000100:00100000:0.0:1787387680.352921:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387680.352950:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709662464 00000100:00100000:0.0:1787387680.352954:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709662464 00000100:00100000:0.0:1787387680.352991:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787387680.352997:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:3311:x1874211709662464:12345-0@lo:400: 00000100:00100000:0.0:1787387680.353028:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:3311:x1874211709662464:12345-0@lo:400: Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387680.353034:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787387680.353065:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709662464:0@lo:400: 00000100:00080000:2.0:1787387680.353719:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387680.353786:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709662976:0@lo:13: 00000100:00100000:2.0:1787387680.353821:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387680.353855:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709662976 00000100:00100000:2.0:1787387680.353860:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709662976 00000100:00100000:2.0:1787387680.353894:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387680.353901:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709662976:12345-0@lo:13: 00002000:00000024:2.0:1787387680.353928:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387680.353966:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709662976:12345-0@lo:13: Request processed in 66us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387680.353986:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787387680.354006:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787387680.354027:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4343525f80 x1874211709662976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387680.354043:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709662976:0@lo:13: 00000100:00100000:1.0:1787387680.354705:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709662848 00000100:00100000:1.0:1787387680.354712:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709662848 00000100:00100000:1.0:1787387680.354786:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387680.354793:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709662848:12345-0@lo:400: 00000100:00100000:1.0:1787387680.354839:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709662848:12345-0@lo:400: Request processed in 47us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387680.354845:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787387680.355043:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4374177b80 x1874211709662848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387680.355054:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709662848:0@lo:400: 00000020:01000004:2.0:1787387680.778674:0:7495:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787387680.778680:0:7495:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787387680.779502:0:7495:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d4377c90800 00000020:01000004:2.0:1787387680.779521:0:7495:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787387680.779536:0:7495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787387680.779551:0:7495:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d43435299c0) 00000020:00000080:2.0:1787387680.779568:0:7495:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787387680.831117:0:7495:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787387680.831476:0:7495:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787387680.896008:0:7495:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787387680.912371:0:7495:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787387680.912410:0:7495:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787387680.912491:0:7495:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787387680.912520:0:7495:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787387680.915774:0:7495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787387680.915788:0:7495:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787387680.915800:0:7495:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x93d41aeaa23c7502 00000020:01000004:2.0:1787387680.915809:0:7495:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787387680.915831:0:7495:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787387680.915834:0:7495:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787387680.915840:0:7495:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787387680.915863:0:7495:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787387680.915867:0:7495:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787387680.960281:0:7495:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787387680.960321:0:7495:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.159@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787387680.960325:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787387680.960327:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787387680.960328:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387680.960329:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387680.960330:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387680.960331:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387680.960333:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787387680.960334:0:7495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787387680.960336:0:7495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787387680.960337:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387680.960338:0:7495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787387680.960342:0:7495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787387680.960345:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787387680.960350:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787387680.960351:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387680.960352:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387680.960353:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387680.960354:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387680.960355:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787387680.960356:0:7495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787387680.960357:0:7495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787387680.960357:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387680.960358:0:7495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787387680.960386:0:7495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787387680.960406:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709663104:0@lo:253: 00000100:00100000:3.0:1787387680.960491:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387680.960549:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387680.961013:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709663104 00000100:00100000:2.0:1787387680.961021:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709663104 00000100:00100000:2.0:1787387680.961086:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787387680.961108:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:7495:x1874211709663104:12345-0@lo:253: 20000000:01000000:2.0:1787387680.961149:0:5802:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787387680.961154:0:5802:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787387680.961159:0:5802:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787387680.961161:0:5802:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787387680.962187:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387680.962424:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787387680.962438:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787387680.962475:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787387680.962482:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787387680.962512:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787387680.962558:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787387680.962954:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787387680.962973:0:5802:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:2.0:1787387680.962975:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:2.0:1787387680.963012:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787387680.963029:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787387680.963082:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787387680.963090:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:2.0:1787387680.963121:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787387680.963131:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787387680.963178:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787387680.963244:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787387680.967318:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787387680.967358:0:5802:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:3.0:1787387680.967361:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:3.0:1787387680.967403:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787387680.967413:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787387680.967446:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787387680.967455:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:3.0:1787387680.967485:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787387680.967495:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787387680.967540:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787387680.967581:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787387680.967601:0:5802:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787387680.967604:0:5802:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787387680.967608:0:5802:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787387680.967621:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787387680.967624:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787387680.967660:0:5802:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787387680.967663:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787387680.969108:0:7497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787387680.969216:0:7497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787387680.969254:0:7497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787387680.969968:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787387680.970017:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787387680.970093:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1787387680.970123:0:5802:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787387680.970126:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787387680.971274:0:7498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787387680.971338:0:7498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787387680.971408:0:7498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787387680.976801:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787387680.976858:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787387680.976896:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787387680.976911:0:5802:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787387680.976913:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787387680.977553:0:7499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787387680.977604:0:7499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787387680.977657:0:7499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787387680.977964:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787387680.978006:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787387680.978283:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787387680.978301:0:5802:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787387680.978304:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787387680.979296:0:7500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787387680.979684:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787387680.979724:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787387680.979957:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787387680.979980:0:5802:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787387680.979982:0:5802:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787387680.979992:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787387680.980012:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980482:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c745a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7453 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980493:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c747d expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980500:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c74ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c74a7 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980524:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d434152e000/0x93d41aeaa23c74ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c74c3 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980531:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c74f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c74ed expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980538:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980577:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c74f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c74ed expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980591:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c74f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c74ed expref: 16 pid: 5800 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387680.980606:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374174a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1874211709663232:0@lo:104: 00000100:00100000:1.0:1787387680.980676:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387680.980824:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d434152e000/0x93d41aeaa23c74ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c74c3 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980833:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d434152e000/0x93d41aeaa23c74ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c74c3 expref: 16 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387680.980840:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374175500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1874211709663360:0@lo:104: 00010000:00010000:1.0:1787387680.980865:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c74ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c74a7 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980873:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c74ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c74a7 expref: 16 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387680.980893:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374177b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1874211709663488:0@lo:104: 00010000:00010000:1.0:1787387680.980920:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c747d expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980928:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c747d expref: 16 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387680.980935:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1874211709663616:0@lo:104: 00010000:00010000:1.0:1787387680.980958:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c745a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c7453 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.980966:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c745a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c7453 expref: 16 pid: 5801 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387680.980973:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374177480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1874211709663744:0@lo:104: 00000100:00100000:1.0:1787387680.980991:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387680.996865:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787387680.996915:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387680.996964:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387680.996975:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387680.996985:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387680.997000:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709663232 00000100:00100000:2.0:1787387680.997008:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709663232 00000100:00100000:2.0:1787387680.997069:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709663360 00000100:00100000:2.0:1787387680.997072:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709663360 00000100:00100000:2.0:1787387680.997084:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709663488 00000100:00100000:2.0:1787387680.997086:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709663488 00000100:00100000:2.0:1787387680.997300:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709663616 00000100:00100000:2.0:1787387680.997304:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709663616 00000100:00100000:2.0:1787387680.997320:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709663744 00000100:00100000:2.0:1787387680.997322:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709663744 00000100:00100000:2.0:1787387680.997337:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787387680.997345:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345040850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+7:5802:x1874211709663232:12345-0@lo:104: 00010000:00010000:2.0:1787387680.997364:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387680.997452:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387680.997458:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345040850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+7:5802:x1874211709663232:12345-0@lo:104: Request processed in 114us (16782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387680.997466:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787387680.997519:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387680.997525:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387680.997532:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030000 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:2.0:1787387680.997536:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387680.997545:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387680.997552:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387680.997558:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387680.997595:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387680.997602:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387680.997618:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387680.997625:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4340030000/0x93d41aeaa23c74ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387680.997639:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387680.997641:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387680.997643:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387680.997660:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387680.997676:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709663872:0@lo:103: 00000100:00100000:2.0:1787387680.997726:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387680.997809:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709663872 00000100:00100000:2.0:1787387680.997814:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709663872 00010000:00010000:2.0:1787387680.997831:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c74f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c74ed expref: 17 pid: 5800 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387680.997851:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787387680.997857:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:3314:x1874211709663872:12345-0@lo:103: 00010000:00010000:2.0:1787387680.997867:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387680.997872:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c74f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c74ed expref: 17 pid: 5800 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387680.997883:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c74f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c74ed expref: 17 pid: 5800 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387680.997900:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387680.997927:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:3314:x1874211709663872:12345-0@lo:103: Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387680.997934:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787387680.997971:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709663872:0@lo:103: 00000100:00100000:2.0:1787387680.997992:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787387680.997998:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+6:5802:x1874211709663360:12345-0@lo:104: 00010000:00010000:2.0:1787387680.998006:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387680.998051:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387680.998056:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+6:5802:x1874211709663360:12345-0@lo:104: Request processed in 58us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387680.998062:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787387680.998075:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387680.998087:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:5802:x1874211709663488:12345-0@lo:104: 00010000:00010000:2.0:1787387680.998094:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.998228:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387680.998235:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.998242:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152ea00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387680.998245:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.998252:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387680.998258:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387680.998271:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387680.998294:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.998300:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387680.998310:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.998317:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d434152ea00/0x93d41aeaa23c74c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.998327:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387680.998329:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387680.998330:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387680.998336:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387680.998343:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709664000:0@lo:103: 00000100:00100000:1.0:1787387680.998382:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387680.998417:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709664000 00000100:00100000:1.0:1787387680.998435:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709664000 00010000:00010000:1.0:1787387680.998454:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d434152e000/0x93d41aeaa23c74ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c74c3 expref: 17 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387680.998474:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387680.998480:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:3313:x1874211709664000:12345-0@lo:103: 00010000:00010000:1.0:1787387680.998488:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387680.998492:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d434152e000/0x93d41aeaa23c74ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c74c3 expref: 17 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.998501:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d434152e000/0x93d41aeaa23c74ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c74c3 expref: 17 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387680.998517:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387680.998546:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:3313:x1874211709664000:12345-0@lo:103: Request processed in 66us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387680.998552:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387680.998580:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709664000:0@lo:103: 00010000:00010000:1.0:1787387680.998608:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c74f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c74ed expref: 16 pid: 5800 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387680.998617:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374174a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1874211709663232:0@lo:104: 00010000:00010000:1.0:1787387680.998624:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152e000/0x93d41aeaa23c74ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c74c3 expref: 15 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387680.998631:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374175500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1874211709663360:0@lo:104: 00000100:00100000:1.0:1787387681.002229:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374177b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1874211709663488:0@lo:104: 00010000:00010000:3.0:1787387681.007925:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387681.007939:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387681.007970:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4000 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:3.0:1787387681.007974:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387681.007983:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387681.007990:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387681.007995:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387681.008065:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387681.008072:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387681.008112:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387681.008120:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c74a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387681.008138:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387681.008140:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387681.008142:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387681.008158:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387681.008180:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709664128:0@lo:103: 00000100:00100000:3.0:1787387681.008262:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387681.008327:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709664128 00000100:00100000:3.0:1787387681.008335:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709664128 00010000:00010000:3.0:1787387681.008370:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c74ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c74a7 expref: 15 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387681.008396:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387681.008404:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:3312:x1874211709664128:12345-0@lo:103: 00010000:00010000:3.0:1787387681.008416:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387681.008432:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c74ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c74a7 expref: 15 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387681.008444:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c74ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c74a7 expref: 15 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387681.008459:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c74ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c74a7 expref: 15 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387681.008474:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387681.008507:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:3312:x1874211709664128:12345-0@lo:103: Request processed in 103us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387681.008514:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387681.008550:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709664128:0@lo:103: 00010000:00010000:2.0:1787387681.010258:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787387681.010275:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:5802:x1874211709663488:12345-0@lo:104: Request processed in 12184us (13306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387681.010286:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387681.010318:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387681.010331:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343524000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:5802:x1874211709663616:12345-0@lo:104: 00010000:00010000:2.0:1787387681.010345:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010448:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387681.010454:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343524000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:5802:x1874211709663616:12345-0@lo:104: Request processed in 129us (13478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387681.010459:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387681.010473:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387681.010479:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:5802:x1874211709663744:12345-0@lo:104: 00010000:00010000:2.0:1787387681.010486:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010521:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787387681.010526:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:5802:x1874211709663744:12345-0@lo:104: Request processed in 48us (13540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387681.010530:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787387681.010547:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387681.010568:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010574:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340031600 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:2.0:1787387681.010577:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010584:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387681.010590:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387681.010595:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387681.010626:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010632:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387681.010645:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010651:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4340031600/0x93d41aeaa23c747d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7484 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010664:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387681.010667:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010672:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5800 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:2.0:1787387681.010675:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010693:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387681.010699:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387681.010703:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387681.010717:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010723:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387681.010734:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010763:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5800/0x93d41aeaa23c7453 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c745a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.010778:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387681.010779:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387681.010781:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387681.010796:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709664256:0@lo:103: 00000100:00100000:2.0:1787387681.010829:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387681.011292:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387681.011415:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709664384:0@lo:103: 00000100:00100000:1.0:1787387681.011447:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.011498:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709664256 00000100:00100000:1.0:1787387681.011506:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709664256 00010000:00010000:1.0:1787387681.011534:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7484 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c747d expref: 14 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387681.011564:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709664384 00000100:00100000:1.0:1787387681.011568:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709664384 00010000:00010000:1.0:1787387681.011578:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c745a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7453 expref: 15 pid: 5801 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387681.011590:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787387681.011605:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:3312:x1874211709664256:12345-0@lo:103: 00010000:00010000:1.0:1787387681.011615:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387681.011621:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7484 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c747d expref: 15 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011632:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c747d expref: 15 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011648:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387681.011679:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:3312:x1874211709664256:12345-0@lo:103: Request processed in 75us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.011686:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787387681.011701:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787387681.011707:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:3313:x1874211709664384:12345-0@lo:103: 00010000:00010000:1.0:1787387681.011714:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387681.011718:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c745a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7453 expref: 14 pid: 5801 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011726:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c745a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c7453 expref: 14 pid: 5801 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011761:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011770:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011785:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011802:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011809:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011815:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011821:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5600 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387681.011825:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011832:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011841:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.011849:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387681.011876:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:3313:x1874211709664384:12345-0@lo:103: Request processed in 169us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.011883:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787387681.011916:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709664256:0@lo:103: 00000100:00100000:1.0:1787387681.011944:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709664384:0@lo:103: 00010000:00010000:1.0:1787387681.011967:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad4800/0x93d41aeaa23c7484 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c747d expref: 13 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387681.011978:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1874211709663616:0@lo:104: 00010000:00010000:1.0:1787387681.011999:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c745a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c7453 expref: 12 pid: 5801 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387681.012008:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374177480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1874211709663744:0@lo:104: 00010000:00010000:1.0:1787387681.012040:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.012049:0:5802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.012055:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.012060:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7509 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787387681.012074:0:5802:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787387681.079992:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:7495:x1874211709663104:12345-0@lo:253: Request processed in 118887us (119493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387681.080007:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787387681.080155:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709663104:0@lo:253: 10000000:01000000:0.0:1787387681.080171:0:7495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787387681.080175:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787387681.080176:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787387681.080178:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387681.080179:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787387681.080207:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387681.080209:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387681.080210:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787387681.080212:0:7495:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787387681.080213:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387681.080214:0:7495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787387681.080235:0:7495:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d4377c90800 from lustre-OST0001 10000000:01000000:0.0:1787387681.080262:0:7495:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787387681.080264:0:7495:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787387681.080272:0:7495:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d43434a99c0 local copy 10000000:01000000:0.0:1787387681.080276:0:7495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787387681.080316:0:7495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.080328:0:7495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.080339:0:7495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387681.080357:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709664512:0@lo:101: 00000100:00100000:0.0:1787387681.080395:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387681.080452:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374276a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387681.080665:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709664512 00000100:00100000:1.0:1787387681.080673:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709664512 00000100:00100000:1.0:1787387681.080722:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787387681.080732:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:7495:x1874211709664512:12345-0@lo:101: 00010000:00010000:1.0:1787387681.080763:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387681.080779:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7510 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.080801:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7510 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.080812:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7510 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.080833:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5600, rc 0) 00000100:00100000:1.0:1787387681.080879:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709664512:12345-0@lo:101: Request processed in 149us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.080886:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787387681.080974:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709664512:0@lo:101: 00010000:00010000:3.0:1787387681.080988:0:7495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387681.080997:0:7495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387681.081140:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709664640:0@lo:501: 00000100:00100000:3.0:1787387681.081170:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387681.081211:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387681.081465:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709664640 00000100:00100000:1.0:1787387681.081470:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709664640 00000100:00100000:1.0:1787387681.081513:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787387681.081522:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709664640:12345-0@lo:501: 00000100:00100000:1.0:1787387681.081754:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709664640:12345-0@lo:501: Request processed in 216us (565us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787387681.081762:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787387681.081798:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709664640:0@lo:501: 10000000:01000000:1.0:1787387681.081812:0:7495:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787387681.081839:0:7495:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787387681.081845:0:7495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.081853:0:7495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.081860:0:7495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.081881:0:7495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787387681.081909:0:7495:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d4377c90800 00010000:00010000:1.0:1787387681.081919:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387681.081930:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.081936:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030a00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387681.081940:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.081948:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387681.081955:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387681.081960:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387681.081979:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.081985:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387681.082002:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.082009:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4340030a00/0x93d41aeaa23c7510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x93d41aeaa23c7517 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.082024:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387681.082026:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387681.082027:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387681.082038:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709664768:0@lo:103: 00000100:00100000:1.0:1787387681.082068:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.082118:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709664768 00000100:00100000:1.0:1787387681.082122:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709664768 00000100:00100000:1.0:1787387681.082157:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387681.082163:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:3314:x1874211709664768:12345-0@lo:103: 00010000:00010000:1.0:1787387681.082172:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387681.082184:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad5600/0x93d41aeaa23c7517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c7510 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.082207:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387681.082233:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:3314:x1874211709664768:12345-0@lo:103: Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.082239:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387681.082266:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709664768:0@lo:103: 10000000:01000000:1.0:1787387681.082282:0:7495:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787387681.082288:0:7495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787387681.082291:0:7495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387681.082295:0:7495:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787387681.082298:0:7495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787387681.082316:0:7495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.082324:0:7495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.082333:0:7495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387681.082345:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709664896:0@lo:101: 00000100:00100000:1.0:1787387681.082371:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.082389:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709664896 00000100:00100000:1.0:1787387681.082393:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709664896 00000100:00100000:1.0:1787387681.082416:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787387681.082438:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+11:7495:x1874211709664896:12345-0@lo:101: 00010000:00010000:1.0:1787387681.082447:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387681.082456:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c7525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c751e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.082473:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c7525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c751e expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.082482:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c7525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c751e expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.082489:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4600, rc 0) 00000100:00100000:1.0:1787387681.082514:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709664896:12345-0@lo:101: Request processed in 92us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.082519:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787387681.082540:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387681.082552:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709664896:0@lo:101: 00010000:00010000:1.0:1787387681.082563:0:7495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.082571:0:7495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387681.082633:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665024:0@lo:501: 00000100:00100000:1.0:1787387681.082658:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.082676:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709665024 00000100:00100000:1.0:1787387681.082680:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709665024 00000100:00100000:1.0:1787387681.082695:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387681.082707:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709665024:12345-0@lo:501: 00000100:00100000:1.0:1787387681.082928:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709665024:12345-0@lo:501: Request processed in 221us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.082934:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387681.082967:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387681.082978:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665024:0@lo:501: 00000100:00100000:1.0:1787387681.083002:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665152:0@lo:503: 00000100:00100000:1.0:1787387681.083037:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.083055:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709665152 00000100:00100000:1.0:1787387681.083058:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709665152 00000100:00100000:1.0:1787387681.083073:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787387681.083078:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709665152:12345-0@lo:503: 00000100:00100000:1.0:1787387681.083225:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709665152:12345-0@lo:503: Request processed in 146us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.083231:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787387681.083263:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387681.083274:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665152:0@lo:503: 00000040:00080000:1.0:1787387681.083539:0:7495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787387681.083589:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665280:0@lo:502: 00000100:00100000:1.0:1787387681.083620:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.083641:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709665280 00000100:00100000:1.0:1787387681.083645:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709665280 00000100:00100000:1.0:1787387681.083662:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787387681.083667:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709665280:12345-0@lo:502: 00000100:00100000:1.0:1787387681.083804:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709665280:12345-0@lo:502: Request processed in 136us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.083818:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787387681.083844:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387681.083857:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665280:0@lo:502: 00000040:00080000:1.0:1787387681.084065:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787387681.084108:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787387681.084142:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787387681.084190:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787387681.084242:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787387681.084276:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787387681.086188:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665408:0@lo:502: 00000100:00100000:1.0:1787387681.086282:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.086364:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387681.086435:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709665408 00000100:00100000:3.0:1787387681.086442:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709665408 00000100:00100000:3.0:1787387681.086571:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787387681.086581:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709665408:12345-0@lo:502: 00000100:00100000:3.0:1787387681.086824:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709665408:12345-0@lo:502: Request processed in 243us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387681.086831:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787387681.086920:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665408:0@lo:502: 00000040:00080000:2.0:1787387681.087067:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787387681.087083:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787387681.088023:0:7503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787387681.088032:0:7503:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787387681.088039:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387681.088049:0:7503:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787387681.088056:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787387681.088078:0:7503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d43451819c0) 00000020:00000080:2.0:1787387681.088114:0:7503:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787387681.088121:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787387681.088180:0:7503:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d4377c90800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787387681.088187:0:7503:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787387681.088204:0:7503:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x93d41aeaa23c7533 00010000:00010000:2.0:1787387681.100050:0:7503:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787387681.100436:0:7503:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787387681.104247:0:7503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787387681.104714:0:7503:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787387681.113299:0:7503:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787387681.114387:0:7503:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787387681.118955:0:7503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787387681.118967:0:7503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387681.118974:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387681.118976:0:7503:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787387681.118979:0:7503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387681.118983:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387681.118984:0:7503:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787387681.118986:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787387681.118988:0:7503:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787387681.119044:0:7503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387681.119047:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387681.119048:0:7503:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787387681.119051:0:7503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787387681.119281:0:7495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787387681.119309:0:7495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787387681.119335:0:7495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.119347:0:7495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387681.119355:0:7495:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4377c90800 from 1 10000000:01000000:0.0:1787387681.119357:0:7495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387681.119401:0:7495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.119410:0:7495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.119421:0:7495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387681.119443:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665536:0@lo:101: 00000100:00100000:0.0:1787387681.119510:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387681.119553:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374276a80 going to sleep for 11 seconds 00010000:00010000:0.0:1787387681.119604:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387681.124020:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709665536 00000100:00100000:2.0:1787387681.124037:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709665536 00000100:00100000:2.0:1787387681.124100:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787387681.124111:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:7495:x1874211709665536:12345-0@lo:101: 00010000:00010000:2.0:1787387681.124129:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387681.124155:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c7541 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c753a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.124184:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c7541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c753a expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.124207:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c7541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c753a expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.124216:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fc200, rc 0) 00000100:00100000:2.0:1787387681.124292:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:7495:x1874211709665536:12345-0@lo:101: Request processed in 183us (4782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387681.124299:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787387681.126418:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665536:0@lo:101: 00010000:00010000:0.0:1787387681.126445:0:7495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.126458:0:7495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387681.126585:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665664:0@lo:501: 00000100:00100000:0.0:1787387681.126639:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387681.126681:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374276a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787387681.127891:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709665664 00000100:00100000:3.0:1787387681.127902:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709665664 00000100:00100000:3.0:1787387681.127952:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787387681.127961:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:7495:x1874211709665664:12345-0@lo:501: 00000100:00100000:3.0:1787387681.128474:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:7495:x1874211709665664:12345-0@lo:501: Request processed in 513us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387681.128483:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787387681.135379:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665664:0@lo:501: 00000100:00100000:1.0:1787387681.135433:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665792:0@lo:503: 00000100:00100000:1.0:1787387681.135511:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.135555:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387681.135721:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709665792 00000100:00100000:3.0:1787387681.135728:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709665792 00000100:00100000:3.0:1787387681.135788:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787387681.135795:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:7495:x1874211709665792:12345-0@lo:503: 00000100:00100000:3.0:1787387681.136341:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:7495:x1874211709665792:12345-0@lo:503: Request processed in 544us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387681.136348:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787387681.136460:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665792:0@lo:503: 00000040:00080000:1.0:1787387681.136731:0:7495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787387681.137296:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665920:0@lo:502: 00000100:00100000:1.0:1787387681.137348:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.137386:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387681.139763:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709665920 00000100:00100000:3.0:1787387681.139778:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709665920 00000100:00100000:3.0:1787387681.139847:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787387681.139856:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:7495:x1874211709665920:12345-0@lo:502: 00000100:00100000:3.0:1787387681.140129:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:7495:x1874211709665920:12345-0@lo:502: Request processed in 274us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387681.140137:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787387681.140436:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709665920:0@lo:502: 00000040:00080000:1.0:1787387681.140783:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787387681.140838:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787387681.140870:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666048:0@lo:502: 00000100:00100000:1.0:1787387681.140929:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.140960:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387681.141554:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709666048 00000100:00100000:3.0:1787387681.141562:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709666048 00000100:00100000:3.0:1787387681.141611:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787387681.141619:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:7495:x1874211709666048:12345-0@lo:502: 00000100:00100000:0.0:1787387681.142229:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666048:0@lo:502: 00000040:00080000:0.0:1787387681.142352:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787387681.142367:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:3.0:1787387681.142813:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:7495:x1874211709666048:12345-0@lo:502: Request processed in 1193us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387681.142822:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000020:01000000:0.0:1787387681.142963:0:7507:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387681.142971:0:7507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387681.142974:0:7507:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787387681.142986:0:7507:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4377c90800 00000020:00000080:0.0:1787387681.142988:0:7507:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787387681.143007:0:7507:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387681.143009:0:7507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387681.143011:0:7507:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787387681.143013:0:7507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787387681.143043:0:7495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787387681.143060:0:7495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387681.143072:0:7495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.143083:0:7495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387681.143133:0:7495:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787387681.143137:0:7495:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d4377c90800 10000000:01000000:0.0:1787387681.143141:0:7495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d4377c90800 10000000:01000000:0.0:1787387681.143145:0:7495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787387681.143152:0:7495:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4377c90800 from 1 10000000:01000000:0.0:1787387681.143155:0:7495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787387681.143188:0:7495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.143207:0:7495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.143217:0:7495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387681.143238:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666176:0@lo:101: 00000100:00100000:0.0:1787387681.143280:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387681.143317:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374276780 going to sleep for 11 seconds 00000100:00100000:0.0:1787387681.143334:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709666176 00000100:00100000:0.0:1787387681.143339:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709666176 00000100:00100000:0.0:1787387681.143363:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787387681.143370:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:7495:x1874211709666176:12345-0@lo:101: 00010000:00010000:0.0:1787387681.143378:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387681.143389:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c754f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7548 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.143408:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c754f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7548 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.143419:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c754f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7548 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.143439:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340030a00, rc 0) 00000100:00100000:0.0:1787387681.143471:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7495:x1874211709666176:12345-0@lo:101: Request processed in 101us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387681.143477:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787387681.143512:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666176:0@lo:101: 00010000:00010000:0.0:1787387681.143523:0:7495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.143531:0:7495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387681.143593:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666304:0@lo:501: 00000100:00100000:0.0:1787387681.143615:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387681.143626:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374276780 going to sleep for 11 seconds 00000100:00100000:0.0:1787387681.143641:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709666304 00000100:00100000:0.0:1787387681.143644:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709666304 00000100:00100000:0.0:1787387681.143658:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787387681.143663:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7495:x1874211709666304:12345-0@lo:501: 00000100:00100000:0.0:1787387681.143848:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7495:x1874211709666304:12345-0@lo:501: Request processed in 183us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387681.143855:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787387681.143880:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666304:0@lo:501: 00000100:00100000:0.0:1787387681.143901:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666432:0@lo:503: 00000100:00100000:0.0:1787387681.143931:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387681.143943:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374276780 going to sleep for 11 seconds 00000100:00100000:0.0:1787387681.143956:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709666432 00000100:00100000:0.0:1787387681.143959:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709666432 00000100:00100000:0.0:1787387681.143975:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787387681.143980:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7495:x1874211709666432:12345-0@lo:503: 00000100:00100000:0.0:1787387681.144106:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7495:x1874211709666432:12345-0@lo:503: Request processed in 125us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387681.144112:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787387681.144148:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666432:0@lo:503: 00000040:00080000:0.0:1787387681.144415:0:7495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787387681.144466:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666560:0@lo:502: 00000100:00100000:0.0:1787387681.144502:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387681.144516:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374276780 going to sleep for 11 seconds 00000100:00100000:0.0:1787387681.144531:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709666560 00000100:00100000:0.0:1787387681.144535:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709666560 00000100:00100000:0.0:1787387681.144552:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787387681.144558:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7495:x1874211709666560:12345-0@lo:502: 00000100:00100000:0.0:1787387681.144732:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7495:x1874211709666560:12345-0@lo:502: Request processed in 173us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387681.144766:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787387681.144806:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666560:0@lo:502: 00000040:00080000:0.0:1787387681.145043:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787387681.145090:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787387681.145126:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787387681.145172:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787387681.145225:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787387681.145274:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787387681.145312:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787387681.145347:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787387681.145396:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787387681.145449:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787387681.145485:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787387681.145534:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787387681.145571:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787387681.145621:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787387681.145672:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787387681.145705:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787387681.145735:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787387681.152206:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787387681.152245:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787387681.152272:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787387681.152315:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787387681.152345:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787387681.152373:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787387681.152414:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787387681.153048:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787387681.153087:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787387681.153241:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787387681.153296:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787387681.153329:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787387681.153395:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787387681.153649:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787387681.153692:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787387681.153724:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787387681.153981:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787387681.154023:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787387681.154074:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787387681.154209:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787387681.154261:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666688:0@lo:502: 00000100:00100000:0.0:1787387681.154341:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387681.154424:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374276780 going to sleep for 11 seconds 00000100:00100000:1.0:1787387681.154576:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709666688 00000100:00100000:1.0:1787387681.154583:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709666688 00000100:00100000:1.0:1787387681.154661:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787387681.154670:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7495:x1874211709666688:12345-0@lo:502: 00000100:00100000:1.0:1787387681.154908:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7495:x1874211709666688:12345-0@lo:502: Request processed in 238us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.154915:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787387681.155004:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709666688:0@lo:502: 00000040:00080000:0.0:1787387681.155078:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787387681.155088:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787387681.156154:0:7508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787387681.156171:0:7508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d4242c999c0) 00000020:00000080:0.0:1787387681.156209:0:7508:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787387681.156394:0:7508:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d4377c90800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787387681.156398:0:7508:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4377c90800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787387681.156401:0:7508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4377c90800 3 00010000:00080000:0.0:1787387681.156432:0:7508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4373f2e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1787387681.158179:0:7508:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787387681.158306:0:7508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787387681.158343:0:7508:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787387681.158357:0:7508:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x93d41aeaa23c755d 00000100:00080000:0.0:1787387681.158367:0:7508:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787387681.158372:0:7508:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d4373f2e800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1787387681.158410:0:7508:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d43747c8e00 x1874211709666816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787387681.158458:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874211709666816:0@lo:38: 00000100:00100000:0.0:1787387681.158524:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787387681.158588:0:7508:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787387681.162298:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709666816 00000100:00100000:1.0:1787387681.162313:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709666816 00000100:00100000:1.0:1787387681.162366:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387681.162375:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1874211709666816:12345-0@lo:38: 00010000:00080000:1.0:1787387681.162403:0:5808:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1787387681.162439:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x93d41aeaa23c7564 00000004:00100000:1.0:1787387681.162458:0:5808:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787387681.162493:0:5808:0:(import.c:65:import_set_state_nolock()) ffff8d437a71c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387681.162578:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874211709666816:12345-0@lo:38: Request processed in 202us (4052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.162586:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387681.162675:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709667072:0@lo:400: 00000100:00100000:1.0:1787387681.162710:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387681.164832:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709667072 00000100:00100000:2.0:1787387681.164844:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709667072 00000100:00100000:2.0:1787387681.164896:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387681.164905:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709667072:12345-0@lo:400: 00000100:00100000:2.0:1787387681.164974:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709667072:12345-0@lo:400: Request processed in 71us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387681.164980:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787387681.167380:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387681.167409:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709666944:0@lo:400: 00000100:00100000:1.0:1787387681.167476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787387681.167532:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437f65b800 x1874211709667072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387681.167561:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709667072:0@lo:400: 00000100:00100000:1.0:1787387681.167594:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709667200:0@lo:400: 00000100:00100000:1.0:1787387681.167623:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.167667:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709666944 00000100:00100000:1.0:1787387681.167673:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709666944 00000100:00100000:1.0:1787387681.167717:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787387681.167725:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709666944:12345-0@lo:400: 00000100:00100000:1.0:1787387681.167797:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709666944:12345-0@lo:400: Request processed in 72us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.167804:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787387681.167826:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709667200 00000100:00100000:1.0:1787387681.167830:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709667200 00000100:00100000:1.0:1787387681.167853:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387681.167859:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709667200:12345-0@lo:400: 00000100:00100000:1.0:1787387681.167909:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709667200:12345-0@lo:400: Request processed in 49us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387681.167915:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787387681.167942:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437f659180 x1874211709666944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387681.167951:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709666944:0@lo:400: 00010000:00080000:1.0:1787387681.167976:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437f65bb80 x1874211709667200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387681.167984:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709667200:0@lo:400: 00010000:00080000:0.0:1787387681.168069:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43747c8e00 x1874211709666816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387681.168078:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787387681.168087:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787387681.168106:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787387681.168111:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787387681.168114:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4373f2e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787387681.168121:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874211709666816:0@lo:38: 00000040:00080000:0.0:1787387681.168315:0:7508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787387681.168927:0:7509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65bb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7509:1874211709667328:0@lo:901: 00000100:00100000:1.0:1787387681.168982:0:7509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387681.169012:0:7509:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43742533c0 going to sleep for 11 seconds 00000020:01000000:2.0:1787387681.169120:0:7495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787387681.169148:0:7495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387681.169169:0:7495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.169180:0:7495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787387681.169242:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787387681.169244:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387681.169249:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387681.169251:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387681.169252:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387681.169253:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387681.169254:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387681.169256:0:7495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387681.169257:0:7495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387681.169258:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387681.169260:0:7495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787387681.169263:0:7495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787387681.169265:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787387681.169266:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387681.169267:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387681.169268:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387681.169269:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387681.169270:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387681.169271:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387681.169272:0:7495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387681.169273:0:7495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387681.169274:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387681.169274:0:7495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787387681.169290:0:7495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787387681.169299:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709667456:0@lo:253: 00000100:00100000:2.0:1787387681.169336:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387681.169363:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709667456 00000100:00100000:2.0:1787387681.169369:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709667456 00000100:00100000:2.0:1787387681.169402:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787387681.169410:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7495:x1874211709667456:12345-0@lo:253: 20000000:01000000:2.0:1787387681.169441:0:5800:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787387681.169454:0:5800:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787387681.169941:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373edd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387681.170141:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709667328 00000100:00100000:3.0:1787387681.170147:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709667328 00000100:00100000:3.0:1787387681.170205:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387681.170213:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7509:x1874211709667328:12345-0@lo:901: 00000100:00100000:3.0:1787387681.170489:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7509:x1874211709667328:12345-0@lo:901: Request processed in 277us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387681.170497:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787387681.170614:0:7509:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437f65bb80 x1874211709667328/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787387697 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387681.170627:0:7509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65bb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7509:1874211709667328:0@lo:901: 00000100:00080000:2.0:1787387681.173379:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1787387681.229505:0:5800:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787387681.229520:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787387681.229583:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787387681.229588:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787387681.229613:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.229635:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c74bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c74b5 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.229644:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.229686:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c74bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c74b5 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.229700:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c74bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c74b5 expref: 14 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387681.229735:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1874211709667584:0@lo:104: 00000100:00100000:0.0:1787387681.229904:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387681.229952:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f19180 going to sleep for 11 seconds 00000100:00100000:3.0:1787387681.230111:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709667584 00000100:00100000:3.0:1787387681.230119:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709667584 00000100:00100000:3.0:1787387681.230169:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787387681.230179:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:5823:x1874211709667584:12345-0@lo:104: 00010000:00010000:3.0:1787387681.230204:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387681.230266:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387681.230272:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:5823:x1874211709667584:12345-0@lo:104: Request processed in 95us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387681.230278:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387681.230404:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1874211709667584:0@lo:104: 00010000:00010000:0.0:1787387681.230423:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.230649:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387681.230656:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.230664:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e600 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387681.230668:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.230676:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387681.230682:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387681.230688:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387681.230724:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.230731:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387681.230762:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.230769:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c74b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c74bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387681.230806:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387681.230808:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387681.230810:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387681.230823:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709667712:0@lo:103: 00000100:00100000:1.0:1787387681.230858:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387681.231176:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709667712 00000100:00100000:2.0:1787387681.231182:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709667712 00010000:00010000:2.0:1787387681.231213:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c74bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c74b5 expref: 15 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387681.231283:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387681.231291:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434643f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:3314:x1874211709667712:12345-0@lo:103: 00010000:00010000:2.0:1787387681.231302:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387681.231307:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c74bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c74b5 expref: 15 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.231317:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c74bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c74b5 expref: 15 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.231330:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c74bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c74b5 expref: 15 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.231344:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.231352:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787387681.231365:0:5794:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009967124s 00010000:00010000:2.0:1787387681.231369:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.231377:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.231383:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.231389:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.231400:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340031000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387681.231404:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.231411:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.231430:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387681.231438:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387681.231475:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434643f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:3314:x1874211709667712:12345-0@lo:103: Request processed in 184us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387681.231481:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787387681.231550:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.231558:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387681.231564:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c756b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387681.239893:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709667712:0@lo:103: 00000100:00100000:3.0:1787387681.242445:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:7495:x1874211709667456:12345-0@lo:253: Request processed in 73028us (73100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387681.242460:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787387681.246819:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7495:1874211709667456:0@lo:253: 10000000:01000000:2.0:1787387681.246843:0:7495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787387681.246847:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787387681.246848:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387681.246850:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387681.246851:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387681.246852:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387681.246853:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387681.246855:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387681.246856:0:7495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387681.246857:0:7495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387681.246858:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387681.246860:0:7495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787387681.246876:0:7495:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787387681.262410:0:7495:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787387681.262624:0:7495:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787387681.265720:0:7495:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787387681.268685:0:7495:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787387681.269404:0:7495:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787387681.269613:0:7495:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787387681.270937:0:7495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787387681.571663:0:7495:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787387681.571671:0:7495:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787387681.571710:0:7495:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787387681.571911:0:7495:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787387681.571927:0:7495:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787387681.571954:0:7495:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787387682.141849:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387683.172228:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387684.190863:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387685.221339:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387685.470158:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387685.470184:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709667840:0@lo:13: 00000100:00100000:1.0:1787387685.470254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387685.470382:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709667840 00000100:00100000:2.0:1787387685.470389:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709667840 00000100:00100000:2.0:1787387685.470459:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387685.470470:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709667840:12345-0@lo:13: 00002000:00000024:2.0:1787387685.470507:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387685.470557:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709667840:12345-0@lo:13: Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387685.470564:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787387685.470603:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4343524700 x1874211709667840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387685.470620:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709667840:0@lo:13: 00000100:00080000:3.0:1787387685.470686:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787387686.237867:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387686.498307:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709668352:0@lo:400: 00000100:00100000:3.0:1787387686.498387:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387686.498442:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787387686.498450:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709667968:0@lo:400: 00000100:00100000:3.0:1787387686.498481:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387686.498504:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709668480:0@lo:400: 00000100:00100000:1.0:1787387686.498666:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709667968 00000100:00100000:1.0:1787387686.498675:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709667968 00000100:00100000:1.0:1787387686.498719:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787387686.498729:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:3311:x1874211709667968:12345-0@lo:400: 00000100:00100000:1.0:1787387686.498807:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:3311:x1874211709667968:12345-0@lo:400: Request processed in 79us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387686.498814:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787387686.499264:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709668352 00000100:00100000:0.0:1787387686.499269:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709668352 00000100:00100000:0.0:1787387686.499306:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387686.499314:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709668352:12345-0@lo:400: 00000100:00100000:0.0:1787387686.499353:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709668352:12345-0@lo:400: Request processed in 40us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387686.499360:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787387686.500059:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387686.500417:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709668480 00000100:00100000:0.0:1787387686.500426:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709668480 00000100:00100000:0.0:1787387686.500477:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787387686.500485:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709668480:12345-0@lo:400: 00000100:00100000:0.0:1787387686.500546:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709668480:12345-0@lo:400: Request processed in 50us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387686.500552:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787387686.500792:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcce00 x1874211709668480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387686.500808:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709668480:0@lo:400: 00010000:00080000:3.0:1787387686.500820:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcc700 x1874211709668352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387686.500842:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709668352:0@lo:400: 00000100:00100000:3.0:1787387686.500866:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709667968:0@lo:400: 00000100:00100000:3.0:1787387686.500904:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709668096:0@lo:400: 00000100:00100000:3.0:1787387686.500936:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387686.500970:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387686.500977:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709668224:0@lo:400: 00000100:00100000:3.0:1787387686.501771:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387686.502358:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709668096 00000100:00100000:0.0:1787387686.502366:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709668096 00000100:00100000:0.0:1787387686.502405:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709668224 00000100:00100000:0.0:1787387686.502408:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709668224 00000100:00100000:0.0:1787387686.502432:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787387686.502441:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709668096:12345-0@lo:400: 00000100:00100000:0.0:1787387686.502499:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709668096:12345-0@lo:400: Request processed in 59us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387686.502506:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787387686.502521:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387686.502527:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709668224:12345-0@lo:400: 00000100:00100000:0.0:1787387686.502554:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709668224:12345-0@lo:400: Request processed in 27us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387686.502559:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787387686.502592:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcf800 x1874211709668224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387686.502603:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709668224:0@lo:400: 00010000:00080000:0.0:1787387686.502615:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcc000 x1874211709668096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387686.502623:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709668096:0@lo:400: 00000100:00080000:1.0:1787387686.502829:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787387687.265501:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387688.286151:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387689.314522:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787387689.566313:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787387689.566321:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4379110800 from 30 10000000:01000000:1.0:1787387689.566327:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387689.566378:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387689.566405:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387689.566417:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387689.566442:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709668608:0@lo:101: 00000100:00100000:1.0:1787387689.566512:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387689.566584:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.566674:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709668608 00000100:00100000:2.0:1787387689.566682:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709668608 00000100:00100000:2.0:1787387689.566731:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787387689.566755:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:5804:x1874211709668608:12345-0@lo:101: 00010000:00010000:2.0:1787387689.566768:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387689.566779:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c7579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7572 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.566800:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c7579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7572 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.566811:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c7579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7572 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.566819:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fda00, rc 0) 00000100:00100000:2.0:1787387689.566868:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709668608:12345-0@lo:101: Request processed in 128us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.566881:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787387689.566989:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709668608:0@lo:101: 00010000:00010000:0.0:1787387689.567002:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387689.567011:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387689.567077:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709668736:0@lo:501: 00000100:00100000:0.0:1787387689.567103:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387689.567128:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d434501cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.567249:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709668736 00000100:00100000:2.0:1787387689.567254:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709668736 00000100:00100000:2.0:1787387689.567287:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787387689.567293:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709668736:12345-0@lo:501: 00000100:00100000:2.0:1787387689.567630:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709668736:12345-0@lo:501: Request processed in 337us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.567636:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787387689.567669:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709668736:0@lo:501: 00000100:00100000:2.0:1787387689.567698:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709668864:0@lo:503: 00000100:00100000:2.0:1787387689.567732:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.567768:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f02180 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.567778:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709668864 00000100:00100000:2.0:1787387689.567782:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709668864 00000100:00100000:2.0:1787387689.567798:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787387689.567803:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709668864:12345-0@lo:503: 00000100:00100000:2.0:1787387689.568169:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709668864:12345-0@lo:503: Request processed in 364us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.568176:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787387689.568218:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709668864:0@lo:503: 00000100:00100000:0.0:1787387689.568874:0:7812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7812:1874211709668992:0@lo:502: 00000100:00100000:0.0:1787387689.568917:0:7812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387689.569086:0:7812:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d434501c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.569138:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709668992 00000100:00100000:2.0:1787387689.569144:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709668992 00000100:00100000:2.0:1787387689.569178:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787387689.569186:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7812:x1874211709668992:12345-0@lo:502: 00000100:00100000:2.0:1787387689.569440:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7812:x1874211709668992:12345-0@lo:502: Request processed in 254us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.569453:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787387689.569593:0:7812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7812:1874211709668992:0@lo:502: 00000100:00100000:1.0:1787387689.569639:0:7812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f659500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7812:1874211709669120:0@lo:502: 00000100:00100000:1.0:1787387689.569674:0:7812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387689.569699:0:7812:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43517549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.569808:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709669120 00000100:00100000:2.0:1787387689.569813:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709669120 00000100:00100000:2.0:1787387689.569844:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787387689.569851:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7812:x1874211709669120:12345-0@lo:502: 00000100:00100000:2.0:1787387689.570184:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:7812:x1874211709669120:12345-0@lo:502: Request processed in 333us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.570191:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787387689.570271:0:7812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f659500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7812:1874211709669120:0@lo:502: 00000040:00080000:1.0:1787387689.570292:0:7812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787387689.572679:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787387689.572714:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387689.572726:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.572801:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387689.572812:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787387689.572815:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787387689.572818:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787387689.572858:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.572866:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.572877:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387689.572900:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709669248:0@lo:101: 00000100:00100000:2.0:1787387689.573107:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.573197:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f02d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387689.575841:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709669248 00000100:00100000:0.0:1787387689.575854:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709669248 00000100:00100000:2.0:1787387689.576007:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787387689.576017:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709669248:12345-0@lo:101: 00010000:00010000:2.0:1787387689.576042:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387689.576063:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c7587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7580 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.576090:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c7587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7580 expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.576102:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c7587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7580 expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.576111:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fc600, rc 0) 00000100:00100000:2.0:1787387689.576184:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709669248:12345-0@lo:101: Request processed in 169us (3078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.576191:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787387689.576243:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709669248:0@lo:101: 00010000:00010000:2.0:1787387689.576260:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.576269:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387689.576331:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709669376:0@lo:501: 00000100:00100000:2.0:1787387689.576363:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.576392:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f02d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.576414:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709669376 00000100:00100000:2.0:1787387689.576418:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709669376 00000100:00100000:2.0:1787387689.576438:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787387689.576444:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709669376:12345-0@lo:501: 00000100:00100000:2.0:1787387689.576697:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709669376:12345-0@lo:501: Request processed in 252us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.576705:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787387689.576754:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709669376:0@lo:501: 00000100:00100000:2.0:1787387689.576780:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709669504:0@lo:503: 00000100:00100000:2.0:1787387689.576817:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.576830:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f02d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.576844:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709669504 00000100:00100000:2.0:1787387689.576847:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709669504 00000100:00100000:2.0:1787387689.576865:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787387689.576870:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709669504:12345-0@lo:503: 00000100:00100000:2.0:1787387689.577155:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709669504:12345-0@lo:503: Request processed in 283us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.577162:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787387689.577199:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709669504:0@lo:503: 00000100:00100000:2.0:1787387689.577369:0:7813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7813:1874211709669632:0@lo:502: 00000100:00100000:2.0:1787387689.577406:0:7813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.577424:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709669632 00000100:00100000:2.0:1787387689.577427:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709669632 00000100:00100000:2.0:1787387689.577447:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787387689.577452:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:7813:x1874211709669632:12345-0@lo:502: 00000100:00100000:2.0:1787387689.577592:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:7813:x1874211709669632:12345-0@lo:502: Request processed in 139us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.577604:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787387689.577632:0:7813:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347c15780 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.577644:0:7813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7813:1874211709669632:0@lo:502: 00000020:01000000:2.0:1787387689.577662:0:7813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387689.577670:0:7813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387689.577673:0:7813:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787387689.577677:0:7813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787387689.577678:0:7813:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787387689.577691:0:7813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7813:1874211709669760:0@lo:502: 00000100:00100000:2.0:1787387689.577720:0:7813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.577757:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709669760 00000100:00100000:2.0:1787387689.577761:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709669760 00000100:00100000:2.0:1787387689.577783:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787387689.577789:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:7813:x1874211709669760:12345-0@lo:502: 00000100:00100000:2.0:1787387689.577891:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:7813:x1874211709669760:12345-0@lo:502: Request processed in 101us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.577898:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787387689.577925:0:7813:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347c15780 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.577937:0:7813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7813:1874211709669760:0@lo:502: 00000020:01000000:2.0:1787387689.577953:0:7813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387689.577957:0:7813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387689.577959:0:7813:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787387689.577962:0:7813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787387689.578007:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787387689.578021:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787387689.578045:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.578065:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387689.578074:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787387689.578077:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4350ce4000 from 30 10000000:01000000:2.0:1787387689.578080:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787387689.578111:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.578119:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.578128:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387689.578139:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709669888:0@lo:101: 00000100:00100000:2.0:1787387689.578164:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.578177:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347c15780 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.578188:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709669888 00000100:00100000:2.0:1787387689.578191:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709669888 00000100:00100000:2.0:1787387689.578211:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787387689.578218:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709669888:12345-0@lo:101: 00010000:00010000:2.0:1787387689.578224:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387689.578235:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c7595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c758e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.578254:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c7595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c758e expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.578275:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c7595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c758e expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.578705:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91e00, rc 0) 00000100:00100000:2.0:1787387689.578766:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709669888:12345-0@lo:101: Request processed in 547us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.578772:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787387689.578914:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709669888:0@lo:101: 00010000:00010000:0.0:1787387689.578938:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387689.578952:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387689.579000:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670016:0@lo:501: 00000100:00100000:0.0:1787387689.579025:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387689.579062:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d434501ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.579413:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709670016 00000100:00100000:2.0:1787387689.579419:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709670016 00000100:00100000:2.0:1787387689.579459:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787387689.579466:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709670016:12345-0@lo:501: 00000100:00100000:2.0:1787387689.579713:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709670016:12345-0@lo:501: Request processed in 246us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.579720:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787387689.579778:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670016:0@lo:501: 00000100:00100000:2.0:1787387689.579814:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343527b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670144:0@lo:503: 00000100:00100000:2.0:1787387689.579852:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.579866:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a2a1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.579877:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709670144 00000100:00100000:2.0:1787387689.579881:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709670144 00000100:00100000:2.0:1787387689.579903:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787387689.579909:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709670144:12345-0@lo:503: 00000100:00100000:2.0:1787387689.580314:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709670144:12345-0@lo:503: Request processed in 404us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.580323:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787387689.580410:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343527b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670144:0@lo:503: 00000100:00100000:3.0:1787387689.581145:0:7814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7814:1874211709670272:0@lo:502: 00000100:00100000:3.0:1787387689.581192:0:7814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387689.581224:0:7814:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387689.581341:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709670272 00000100:00100000:0.0:1787387689.581347:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709670272 00000100:00100000:0.0:1787387689.581386:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787387689.581395:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:7814:x1874211709670272:12345-0@lo:502: 00000100:00100000:0.0:1787387689.581594:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:7814:x1874211709670272:12345-0@lo:502: Request processed in 201us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387689.581601:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787387689.581780:0:7814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7814:1874211709670272:0@lo:502: 00000100:00100000:3.0:1787387689.581824:0:7814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7814:1874211709670400:0@lo:502: 00000100:00100000:3.0:1787387689.581858:0:7814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387689.581873:0:7814:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387689.582185:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709670400 00000100:00100000:0.0:1787387689.582191:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709670400 00000100:00100000:0.0:1787387689.582218:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787387689.582225:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:7814:x1874211709670400:12345-0@lo:502: 00000100:00100000:0.0:1787387689.582481:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:7814:x1874211709670400:12345-0@lo:502: Request processed in 256us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387689.582487:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787387689.583083:0:7814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7814:1874211709670400:0@lo:502: 00000040:00080000:2.0:1787387689.583248:0:7814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787387689.586712:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787387689.586767:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787387689.586779:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387689.586792:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387689.586802:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787387689.586805:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4350ce4000 from 5 10000000:01000000:0.0:1787387689.586808:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787387689.586851:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387689.586859:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387689.586885:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387689.586910:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670528:0@lo:101: 00000100:00100000:0.0:1787387689.586986:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387689.587022:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d434501cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.587410:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709670528 00000100:00100000:2.0:1787387689.587418:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709670528 00000100:00100000:2.0:1787387689.587462:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787387689.587471:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709670528:12345-0@lo:101: 00010000:00010000:2.0:1787387689.587484:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387689.587499:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f90e00/0x93d41aeaa23c75a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c759c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.587520:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f90e00/0x93d41aeaa23c75a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c759c expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.587530:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f90e00/0x93d41aeaa23c75a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c759c expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.587538:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90e00, rc 0) 00000100:00100000:2.0:1787387689.587592:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709670528:12345-0@lo:101: Request processed in 121us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.587597:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787387689.587766:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670528:0@lo:101: 00010000:00010000:0.0:1787387689.587782:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387689.587791:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387689.587841:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670656:0@lo:256: 00000100:00100000:0.0:1787387689.587874:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387689.588733:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d434501cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.591516:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709670656 00000100:00100000:2.0:1787387689.591533:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709670656 00000100:00100000:2.0:1787387689.591622:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787387689.591633:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709670656:12345-0@lo:256: 20000000:01000000:2.0:1787387689.591658:0:5801:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787387689.591682:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787387689.591685:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787387689.591846:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709670656:12345-0@lo:256: Request processed in 214us (3969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.591854:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787387689.591925:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670656:0@lo:256: 10000000:01000000:2.0:1787387689.594193:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787387689.594204:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.594217:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387689.594225:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787387689.594228:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787387689.594231:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787387689.594273:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.594282:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.594292:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387689.594327:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670784:0@lo:101: 00000100:00100000:2.0:1787387689.594389:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.595065:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787387689.596966:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709670784 00000100:00100000:0.0:1787387689.596981:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709670784 00000100:00100000:0.0:1787387689.597054:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787387689.597065:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709670784:12345-0@lo:101: 00010000:00010000:0.0:1787387689.597082:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387689.597101:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c75b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c75aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387689.597128:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c75b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c75aa expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387689.597153:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c75b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c75aa expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387689.597163:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340031e00, rc 0) 00000100:00100000:0.0:1787387689.597233:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709670784:12345-0@lo:101: Request processed in 171us (2844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387689.597240:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787387689.598072:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670784:0@lo:101: 00010000:00010000:2.0:1787387689.598107:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.598118:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387689.598200:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670912:0@lo:501: 00000100:00100000:2.0:1787387689.598243:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.598287:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787387689.598464:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709670912 00000100:00100000:0.0:1787387689.598471:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709670912 00000100:00100000:0.0:1787387689.598498:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787387689.598505:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709670912:12345-0@lo:501: 00000100:00100000:0.0:1787387689.598828:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709670912:12345-0@lo:501: Request processed in 322us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387689.598836:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787387689.600519:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709670912:0@lo:501: 00000100:00100000:2.0:1787387689.600584:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709671040:0@lo:503: 00000100:00100000:2.0:1787387689.600646:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.600686:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.601171:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709671040 00000100:00100000:2.0:1787387689.601178:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709671040 00000100:00100000:2.0:1787387689.601216:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787387689.601224:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709671040:12345-0@lo:503: 00000100:00100000:2.0:1787387689.601580:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709671040:12345-0@lo:503: Request processed in 355us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.601587:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787387689.601642:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709671040:0@lo:503: 00000100:00100000:2.0:1787387689.601844:0:7815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7815:1874211709671168:0@lo:502: 00000100:00100000:2.0:1787387689.601880:0:7815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.601900:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709671168 00000100:00100000:2.0:1787387689.601903:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709671168 00000100:00100000:2.0:1787387689.601919:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787387689.601924:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:7815:x1874211709671168:12345-0@lo:502: 00000100:00100000:0.0:1787387689.602382:0:7815:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.603073:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:7815:x1874211709671168:12345-0@lo:502: Request processed in 1146us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.603081:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787387689.603139:0:7815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7815:1874211709671168:0@lo:502: 00000020:01000000:2.0:1787387689.603168:0:7815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787387689.603176:0:7815:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787387689.603183:0:7815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387689.603185:0:7815:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787387689.603190:0:7815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787387689.603194:0:7815:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:2.0:1787387689.603215:0:7815:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787387689.603218:0:7815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787387689.603232:0:7815:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d4345183380) 00000020:00000080:2.0:1787387689.603253:0:7815:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787387689.603259:0:7815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787387689.603346:0:7815:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787387689.603352:0:7815:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787387689.603359:0:7815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c75bf 00010000:00080000:2.0:1787387689.603389:0:7815:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d42411a3000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:2.0:1787387689.603628:0:7815:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787387689.603970:0:7815:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787387689.603981:0:7815:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787387689.604455:0:7815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387689.604672:0:7815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387689.604725:0:7815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787387689.605192:0:7815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787387689.605509:0:7816:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787387689.605513:0:7816:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787387689.606170:0:7815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787387689.606182:0:7815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787387689.606213:0:7815:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787387689.606236:0:7815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x93d41aeaa23c75c6 00000100:00080000:3.0:1787387689.606248:0:7815:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787387689.606254:0:7815:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d42411a3000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1787387689.606291:0:7815:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4345dcce00 x1874211709671296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787387689.606339:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709671296:0@lo:8: 00000100:00100000:3.0:1787387689.606413:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787387689.606484:0:7815:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787387689.606531:0:7815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387689.606536:0:7815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387689.606538:0:7815:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787387689.606540:0:7815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387689.606545:0:7815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387689.606546:0:7815:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787387689.606549:0:7815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787387689.606551:0:7815:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787387689.606581:0:7815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7815:1874211709671424:0@lo:502: 00000100:00100000:3.0:1787387689.606621:0:7815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387689.606649:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709671424 00000100:00100000:3.0:1787387689.606658:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709671424 00000100:00100000:3.0:1787387689.606697:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787387689.606705:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:7815:x1874211709671424:12345-0@lo:502: 00000100:00100000:3.0:1787387689.606971:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:7815:x1874211709671424:12345-0@lo:502: Request processed in 265us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387689.606979:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787387689.607019:0:7815:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda900 going to sleep for 11 seconds 00000100:00100000:3.0:1787387689.607049:0:7815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:7815:1874211709671424:0@lo:502: 00000020:01000000:3.0:1787387689.607073:0:7815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387689.607077:0:7815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387689.607079:0:7815:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787387689.607082:0:7815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1787387689.607460:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709671296 00000100:00100000:2.0:1787387689.607465:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709671296 00000100:00100000:2.0:1787387689.607501:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387689.607506:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874211709671296:12345-0@lo:8: 00010000:00080000:2.0:1787387689.607530:0:6604:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1787387689.607554:0:6604:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x93d41aeaa23c75cd 00002000:00100000:2.0:1787387689.607579:0:6604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d42411a1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787387689.607591:0:6604:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787387689.607596:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787387689.607720:0:6604:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787387689.607894:0:6604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787387689.607921:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d42411a2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387689.607991:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874211709671296:12345-0@lo:8: Request processed in 483us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.607998:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:2.0:1787387689.608096:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787387689.608117:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787387689.608126:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.608137:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387689.608148:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787387689.608150:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d43434a99c0 from 1 10000000:01000000:2.0:1787387689.608153:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787387689.608175:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.608182:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.608191:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387689.608205:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343526a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709672064:0@lo:101: 00000100:00100000:2.0:1787387689.608248:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.608267:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c4e40 going to sleep for 11 seconds 00010000:00080000:2.0:1787387689.608305:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcce00 x1874211709671296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387689.608313:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787387689.608320:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787387689.608328:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787387689.608333:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787387689.608335:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d42411a3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787387689.608343:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787387689.608348:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709671296:0@lo:8: 00000100:00100000:2.0:1787387689.608372:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709671552:0@lo:400: 00000100:00100000:2.0:1787387689.608399:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.608419:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387689.608424:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709671680:0@lo:400: 00000100:00100000:2.0:1787387689.608447:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.608475:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709671808:0@lo:400: 00000100:00100000:2.0:1787387689.608500:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.608517:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387689.608522:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709671936:0@lo:400: 00000100:00100000:2.0:1787387689.608542:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.608571:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709672064 00000100:00100000:2.0:1787387689.608577:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709672064 00000100:00100000:2.0:1787387689.608608:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787387689.608614:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709672064:12345-0@lo:101: 00010000:00010000:2.0:1787387689.608624:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387689.608645:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c75db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c75d4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.608669:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c75db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c75d4 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.608679:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c75db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c75d4 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.608687:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91200, rc 0) 00000100:00100000:2.0:1787387689.608717:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709672064:12345-0@lo:101: Request processed in 103us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.608723:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787387689.608774:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709671552 00000100:00100000:2.0:1787387689.608778:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709671552 00000100:00100000:2.0:1787387689.608801:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709671680 00000100:00100000:2.0:1787387689.608805:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709671680 00000100:00100000:2.0:1787387689.608832:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709671936 00000100:00100000:2.0:1787387689.608835:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709671936 00000100:00100000:2.0:1787387689.608849:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787387689.608855:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709671552:12345-0@lo:400: 00000100:00100000:2.0:1787387689.608890:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709671552:12345-0@lo:400: Request processed in 35us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.608896:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787387689.608907:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787387689.608913:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709671680:12345-0@lo:400: 00000100:00100000:2.0:1787387689.608939:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709671680:12345-0@lo:400: Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.608944:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787387689.608963:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787387689.608969:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709671936:12345-0@lo:400: 00000100:00100000:2.0:1787387689.609002:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709671936:12345-0@lo:400: Request processed in 34us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.609008:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787387689.609043:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709671808 00000100:00100000:2.0:1787387689.609046:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709671808 00000100:00100000:2.0:1787387689.609073:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387689.609079:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709671808:12345-0@lo:400: 00000100:00100000:2.0:1787387689.609107:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709671808:12345-0@lo:400: Request processed in 29us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.609113:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787387689.609147:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4343524380 x1874211709671936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387689.609158:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709671936:0@lo:400: 00010000:00080000:2.0:1787387689.609168:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4343525500 x1874211709671808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387689.609176:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709671808:0@lo:400: 00010000:00080000:2.0:1787387689.609202:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4343527480 x1874211709671680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387689.609211:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709671680:0@lo:400: 00010000:00080000:2.0:1787387689.609221:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4343524a80 x1874211709671552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387689.609227:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709671552:0@lo:400: 00000100:00100000:2.0:1787387689.609247:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343526a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709672064:0@lo:101: 00010000:00010000:2.0:1787387689.609272:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.609280:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387689.609324:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343526a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709672192:0@lo:501: 00000100:00100000:2.0:1787387689.609351:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.609365:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387689.609378:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709672192 00000100:00100000:2.0:1787387689.609381:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709672192 00000100:00100000:2.0:1787387689.609402:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787387689.609410:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709672192:12345-0@lo:501: 00000100:00100000:2.0:1787387689.609626:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709672192:12345-0@lo:501: Request processed in 217us (274us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387689.609634:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787387689.609662:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343526a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709672192:0@lo:501: 10000000:01000000:2.0:1787387689.609683:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787387689.609690:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387689.609697:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787387689.610904:0:7816:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787387689.611139:0:7816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 194060399420ns, next at 0ns, rc = 0 00000100:00080000:1.0:1787387689.611350:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387689.611357:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387689.669581:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709672320:0@lo:13: 00000100:00100000:2.0:1787387689.669645:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.669701:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709672320 00000100:00100000:2.0:1787387689.669716:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709672320 00000100:00100000:2.0:1787387689.669791:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787387689.669800:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874211709672320:12345-0@lo:13: 00002000:00000024:2.0:1787387689.669833:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787387689.669880:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874211709672320:12345-0@lo:13: Request processed in 81us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.669888:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787387689.669909:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787387689.669937:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4343526a00 x1874211709672320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387689.669956:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709672320:0@lo:13: 00000004:00080000:2.0:1787387689.669973:0:7817:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787387689.669992:0:7817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343526a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7817:1874211709672448:0@lo:7: 00000100:00100000:2.0:1787387689.670018:0:7817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387689.670240:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709672448 00000100:00100000:2.0:1787387689.670244:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709672448 00000100:00100000:2.0:1787387689.670273:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787387689.670281:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7817:x1874211709672448:12345-0@lo:7: 00000100:00100000:1.0:1787387689.676819:0:7817:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c4780 going to sleep for 11 seconds 00002000:00080000:2.0:1787387689.678079:0:6606:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787387689.678087:0:6606:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787387689.678180:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7817:x1874211709672448:12345-0@lo:7: Request processed in 7896us (8156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.678191:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787387689.678692:0:7817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4343526a00 x1874211709672448/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787387705 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387689.678708:0:7817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343526a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7817:1874211709672448:0@lo:7: 00000004:00080000:1.0:1787387689.678725:0:7817:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787387689.678786:0:7817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f659500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7817:1874211709672576:0@lo:5: 00000100:00100000:1.0:1787387689.678820:0:7817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387689.678849:0:7817:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387689.679430:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709672576 00000100:00100000:0.0:1787387689.679438:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709672576 00000100:00100000:0.0:1787387689.679481:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387689.679491:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7817:x1874211709672576:12345-0@lo:5: 00002000:00080000:0.0:1787387689.679520:0:6605:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787387689.679523:0:6605:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787387689.680453:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7817:x1874211709672576:12345-0@lo:5: Request processed in 960us (1629us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787387689.680463:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787387689.681250:0:7817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437f659500 x1874211709672576/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387705 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387689.681270:0:7817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f659500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7817:1874211709672576:0@lo:5: 00000004:00080000:1.0:1787387689.681282:0:7817:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787387689.681317:0:7817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7817:1874211709672704:0@lo:700: 00000100:00100000:1.0:1787387689.681354:0:7817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387689.681385:0:7817:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754600 going to sleep for 11 seconds 00000100:00100000:3.0:1787387689.682288:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709672704 00000100:00100000:3.0:1787387689.682302:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709672704 00000100:00100000:3.0:1787387689.682362:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387689.682371:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7817:x1874211709672704:12345-0@lo:700: 00000100:00100000:3.0:1787387689.682476:0:6612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6612:1874211709672832:0@lo:700: 00000100:00100000:3.0:1787387689.682516:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387689.682543:0:6612:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda480 going to sleep for 11 seconds 00000100:00100000:3.0:1787387689.682577:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709672832 00000100:00100000:3.0:1787387689.682581:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709672832 00000100:00100000:3.0:1787387689.682607:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387689.682614:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6612:x1874211709672832:12345-0@lo:700: 00000004:00080000:1.0:1787387689.716249:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1787387689.751458:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787387689.764056:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6612:x1874211709672832:12345-0@lo:700: Request processed in 81432us (81529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387689.764070:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787387689.769500:0:6612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcdf80 x1874211709672832/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787387705 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387689.769519:0:6612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6612:1874211709672832:0@lo:700: 40000000:02000000:2.0:1787387689.769535:0:6612:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1787387689.917948:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787387689.917980:0:7514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787387689.918409:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7817:x1874211709672704:12345-0@lo:700: Request processed in 236034us (237049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387689.918429:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787387689.918554:0:7817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437f65b480 x1874211709672704/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787387705 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387689.918567:0:7817:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787387689.918587:0:7817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7817:1874211709672704:0@lo:700: 00000004:02000040:1.0:1787387690.013871:0:7817:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787387690.031094:0:7817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7817:1874211709672960:0@lo:5: 00000100:00100000:1.0:1787387690.031163:0:7817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387690.032105:0:7817:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387690.037290:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709672960 00000100:00100000:3.0:1787387690.037303:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709672960 00000100:00100000:3.0:1787387690.037364:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387690.037373:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7817:x1874211709672960:12345-0@lo:5: 00002000:00080000:3.0:1787387690.048430:0:6606:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787387690.048454:0:6606:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787387690.053685:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7817:x1874211709672960:12345-0@lo:5: Request processed in 16306us (22514us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787387690.053698:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787387690.053816:0:7817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437f65b480 x1874211709672960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387706 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387690.053837:0:7817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7817:1874211709672960:0@lo:5: 00000004:00080000:1.0:1787387690.053852:0:7817:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:2.0:1787387690.223652:0:7862:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787387690.338054:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387690.592382:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387690.592412:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709673088:0@lo:13: 00000100:00100000:1.0:1787387690.592489:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387690.592786:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709673088 00000100:00100000:2.0:1787387690.592797:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709673088 00000100:00100000:2.0:1787387690.592856:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787387690.592867:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709673088:12345-0@lo:13: 00002000:00000024:2.0:1787387690.592923:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387690.592985:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709673088:12345-0@lo:13: Request processed in 119us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387690.592993:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787387690.593048:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4343525500 x1874211709673088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387690.593068:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709673088:0@lo:13: 00010000:00010000:2.0:1787387691.359276:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387692.390430:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387693.406605:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387694.433586:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387694.686059:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709673216:0@lo:400: 00000100:00100000:3.0:1787387694.686145:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387694.686187:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709673728:0@lo:400: 00000100:00100000:3.0:1787387694.686219:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387694.686244:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787387694.686249:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709673344:0@lo:400: 00000100:00100000:3.0:1787387694.686280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387694.686297:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709673856:0@lo:400: 00000100:00100000:3.0:1787387694.686319:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387694.686348:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709673472:0@lo:400: 00000100:00100000:3.0:1787387694.686370:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387694.686402:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387694.686408:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709673600:0@lo:400: 00000100:00100000:3.0:1787387694.686431:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387694.686462:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709673216 00000100:00100000:3.0:1787387694.686470:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709673216 00000100:00100000:3.0:1787387694.686515:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787387694.686523:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709673216:12345-0@lo:400: 00000100:00100000:3.0:1787387694.686566:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709673216:12345-0@lo:400: Request processed in 44us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387694.686573:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787387694.686603:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709673728 00000100:00100000:3.0:1787387694.686607:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709673728 00000100:00100000:3.0:1787387694.686636:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709673344 00000100:00100000:3.0:1787387694.686640:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709673344 00000100:00100000:3.0:1787387694.686651:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709673472 00000100:00100000:3.0:1787387694.686653:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709673472 00000100:00100000:3.0:1787387694.686669:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387694.686675:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709673728:12345-0@lo:400: 00000100:00100000:3.0:1787387694.686704:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709673728:12345-0@lo:400: Request processed in 30us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387694.686717:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387694.686732:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787387694.686759:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709673344:12345-0@lo:400: 00000100:00100000:3.0:1787387694.686785:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709673344:12345-0@lo:400: Request processed in 49us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387694.686791:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787387694.686802:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787387694.686807:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709673472:12345-0@lo:400: 00000100:00100000:3.0:1787387694.686851:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709673472:12345-0@lo:400: Request processed in 43us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387694.686856:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787387694.686875:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709673856 00000100:00100000:3.0:1787387694.686878:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709673856 00000100:00100000:3.0:1787387694.686899:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709673600 00000100:00100000:3.0:1787387694.686902:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709673600 00000100:00100000:3.0:1787387694.686914:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387694.686920:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874211709673856:12345-0@lo:400: 00000100:00100000:3.0:1787387694.686960:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874211709673856:12345-0@lo:400: Request processed in 40us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387694.686966:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387694.686977:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787387694.686983:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709673600:12345-0@lo:400: 00000100:00100000:3.0:1787387694.687008:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709673600:12345-0@lo:400: Request processed in 25us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387694.687014:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787387694.687034:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387694.687044:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787387694.687047:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787387694.687079:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcdf80 x1874211709673600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387694.687093:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709673600:0@lo:400: 00010000:00080000:3.0:1787387694.687103:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dced80 x1874211709673472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387694.687111:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709673472:0@lo:400: 00010000:00080000:3.0:1787387694.687141:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcd880 x1874211709673344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387694.687149:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709673344:0@lo:400: 00010000:00080000:3.0:1787387694.687158:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcc000 x1874211709673856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387694.687166:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709673856:0@lo:400: 00000100:00100000:3.0:1787387694.687173:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709673216:0@lo:400: 00010000:00080000:3.0:1787387694.687181:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcce00 x1874211709673728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387694.687188:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709673728:0@lo:400: 00000100:00100000:1.0:1787387694.689025:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387694.689054:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709673984:0@lo:13: 00000100:00100000:1.0:1787387694.689140:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387694.689188:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709673984 00000100:00100000:1.0:1787387694.689195:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709673984 00000100:00100000:1.0:1787387694.689238:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387694.689246:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709673984:12345-0@lo:13: 00002000:00000024:1.0:1787387694.689281:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387694.689324:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709673984:12345-0@lo:13: Request processed in 78us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387694.689330:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787387694.689550:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437f65b100 x1874211709673984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387694.689570:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709673984:0@lo:13: 00000001:00080000:3.0:1787387695.321976:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787387695.453998:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387695.711871:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709674112:0@lo:13: 00000100:00100000:1.0:1787387695.711968:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387695.712125:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709674112 00000100:00100000:0.0:1787387695.712134:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709674112 00000100:00100000:0.0:1787387695.712186:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787387695.712203:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709674112:12345-0@lo:13: 00002000:00000024:0.0:1787387695.712239:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387695.712289:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709674112:12345-0@lo:13: Request processed in 88us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387695.712297:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787387695.712335:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43747c9500 x1874211709674112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387695.712353:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709674112:0@lo:13: 00010000:00010000:3.0:1787387696.478119:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387697.503247:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387697.707168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387697.707793:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690774912 00000100:00100000:2.0:1787387697.707804:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690774912 00000100:00100000:2.0:1787387697.707847:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00100000:2.0:1787387697.707855:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2349:x1874211690774912:12345-192.168.204.59@tcp:250: 00010000:00080000:2.0:1787387697.707892:0:5802:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 76cb2ca2-9623-47c7-b3c7-b630f764b01d@192.168.204.59@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:2.0:1787387697.707920:0:5802:0:(genops.c:1406:class_connect()) connect: client 76cb2ca2-9623-47c7-b3c7-b630f764b01d, cookie 0x93d41aeaa23c75e2 00000100:00080000:2.0:1787387697.708066:0:5802:0:(import.c:65:import_set_state_nolock()) ffff8d42411a7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387697.708159:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+5:2349:x1874211690774912:12345-192.168.204.59@tcp:250: Request processed in 303us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.708168:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00100000:3.0:1787387697.712616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387697.713437:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690774784 00000100:00100000:2.0:1787387697.713449:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690774784 00000100:00100000:2.0:1787387697.713518:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:2.0:1787387697.713528:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+5:5555:x1874211690774784:12345-192.168.204.59@tcp:101: 00010000:00010000:2.0:1787387697.713546:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387697.713565:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c75e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52706 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.713593:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c75e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52706 expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.713605:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c75e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52706 expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.713614:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91a00, rc 0) 00000100:00100000:2.0:1787387697.714391:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+6:5555:x1874211690774784:12345-192.168.204.59@tcp:101: Request processed in 855us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.714403:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:1.0:1787387697.722761:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387697.727758:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690775040 00000100:00100000:3.0:1787387697.727841:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690775040 00000100:00100000:3.0:1787387697.727941:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00100000:3.0:1787387697.727952:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+6:5555:x1874211690775040:12345-192.168.204.59@tcp:501: 00000100:00100000:3.0:1787387697.728267:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+6:5555:x1874211690775040:12345-192.168.204.59@tcp:501: Request processed in 316us (5530us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787387697.728276:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00100000:0.0:1787387697.734297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387697.734464:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690775168 00000100:00100000:2.0:1787387697.734475:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690775168 00000100:00100000:2.0:1787387697.734588:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 117 00000100:00100000:2.0:1787387697.734599:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+6:5555:x1874211690775168:12345-192.168.204.59@tcp:101: 00010000:00010000:2.0:1787387697.734617:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387697.734633:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f90600/0x93d41aeaa23c75f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5270d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.734683:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f90600/0x93d41aeaa23c75f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5270d expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.734693:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f90600/0x93d41aeaa23c75f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5270d expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.734702:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90600, rc 0) 00000100:00100000:2.0:1787387697.734797:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+7:5555:x1874211690775168:12345-192.168.204.59@tcp:101: Request processed in 200us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.734804:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 117 00000100:00100000:0.0:1787387697.748942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387697.749439:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690775296 00000100:00100000:2.0:1787387697.749451:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690775296 00000100:00100000:2.0:1787387697.749573:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 118 00000100:00100000:2.0:1787387697.749584:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+7:5555:x1874211690775296:12345-192.168.204.59@tcp:501: 00000100:00100000:2.0:1787387697.751292:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+8:5555:x1874211690775296:12345-192.168.204.59@tcp:501: Request processed in 1700us (2351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.751306:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 118 00000100:00100000:1.0:1787387697.759730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387697.769151:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690775424 00000100:00100000:2.0:1787387697.769174:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690775424 00000100:00100000:2.0:1787387697.769332:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00100000:2.0:1787387697.769345:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+8:5555:x1874211690775424:12345-192.168.204.59@tcp:503: 00000100:00100000:2.0:1787387697.769794:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+8:5555:x1874211690775424:12345-192.168.204.59@tcp:503: Request processed in 450us (10074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.769803:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00100000:0.0:1787387697.778949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387697.779092:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690775552 00000100:00100000:2.0:1787387697.779115:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690775552 00000100:00100000:2.0:1787387697.779166:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:2.0:1787387697.779175:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+8:5573:x1874211690775552:12345-192.168.204.59@tcp:502: 00000100:00100000:2.0:1787387697.779685:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+8:5573:x1874211690775552:12345-192.168.204.59@tcp:502: Request processed in 509us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.779695:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:0.0:1787387697.838864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387697.839429:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690775680 00000100:00100000:2.0:1787387697.839445:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690775680 00000100:00100000:3.0:1787387697.840581:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:3.0:1787387697.840602:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+8:5573:x1874211690775680:12345-192.168.204.59@tcp:502: 00000100:00100000:2.0:1787387697.842684:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+8:5573:x1874211690775680:12345-192.168.204.59@tcp:502: Request processed in 2081us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.842697:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:1.0:1787387697.853849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387697.853958:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690775808 00000100:00100000:2.0:1787387697.853967:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690775808 00000100:00100000:2.0:1787387697.854031:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:2.0:1787387697.854042:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+8:5555:x1874211690775808:12345-192.168.204.59@tcp:101: 00010000:00010000:2.0:1787387697.854061:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387697.854082:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f91600/0x93d41aeaa23c75f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52737 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.854112:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f91600/0x93d41aeaa23c75f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52737 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.854123:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f91600/0x93d41aeaa23c75f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52737 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.854133:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91600, rc 0) 00000100:00100000:2.0:1787387697.854333:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:5555:x1874211690775808:12345-192.168.204.59@tcp:101: Request processed in 292us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.854359:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:0.0:1787387697.866479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387697.866564:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690775936 00000100:00100000:3.0:1787387697.866576:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690775936 00000100:00100000:3.0:1787387697.866646:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:3.0:1787387697.866658:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:5555:x1874211690775936:12345-192.168.204.59@tcp:256: 20000000:01000000:3.0:1787387697.866685:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787387697.866714:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787387697.866718:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787387697.866721:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787387697.866723:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787387697.877155:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:5555:x1874211690775936:12345-192.168.204.59@tcp:256: Request processed in 10488us (10688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387697.877593:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:1.0:1787387697.881296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387697.881427:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690776064 00000100:00100000:2.0:1787387697.881439:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690776064 00000100:00100000:2.0:1787387697.881510:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:2.0:1787387697.881521:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:5555:x1874211690776064:12345-192.168.204.59@tcp:101: 00010000:00010000:2.0:1787387697.881541:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387697.881562:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f91000/0x93d41aeaa23c75fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5273e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.881591:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f91000/0x93d41aeaa23c75fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5273e expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.881601:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f91000/0x93d41aeaa23c75fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5273e expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387697.881611:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91000, rc 0) 00000100:00100000:2.0:1787387697.881678:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5555:x1874211690776064:12345-192.168.204.59@tcp:101: Request processed in 158us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.881685:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:3.0:1787387697.884407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387697.884648:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690776192 00000100:00100000:0.0:1787387697.884658:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690776192 00000100:00100000:0.0:1787387697.884718:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:0.0:1787387697.884729:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434657a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5555:x1874211690776192:12345-192.168.204.59@tcp:501: 00000100:00100000:0.0:1787387697.885058:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434657a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5555:x1874211690776192:12345-192.168.204.59@tcp:501: Request processed in 329us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387697.885066:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:3.0:1787387697.887461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387697.887670:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690776320 00000100:00100000:0.0:1787387697.887682:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690776320 00000100:00100000:0.0:1787387697.887793:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:0.0:1787387697.887819:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5555:x1874211690776320:12345-192.168.204.59@tcp:503: 00000100:00100000:2.0:1787387697.888590:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5555:x1874211690776320:12345-192.168.204.59@tcp:503: Request processed in 770us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.888600:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:1.0:1787387697.892854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387697.892954:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690776448 00000100:00100000:2.0:1787387697.892964:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690776448 00000100:00100000:2.0:1787387697.893018:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:2.0:1787387697.893029:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434657b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5578:x1874211690776448:12345-192.168.204.59@tcp:502: 00000100:00100000:2.0:1787387697.893475:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434657b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5578:x1874211690776448:12345-192.168.204.59@tcp:502: Request processed in 447us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.893492:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:0.0:1787387697.896986:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387697.904937:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690776576 00000100:00100000:2.0:1787387697.904954:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690776576 00000100:00100000:2.0:1787387697.905076:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:2.0:1787387697.905088:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5578:x1874211690776576:12345-192.168.204.59@tcp:502: 00000100:00100000:2.0:1787387697.905397:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5578:x1874211690776576:12345-192.168.204.59@tcp:502: Request processed in 310us (8421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387697.905405:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:3.0:1787387697.911181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387697.911335:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690776704 00000100:00100000:1.0:1787387697.911347:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690776704 00000100:00100000:1.0:1787387697.911403:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1787387697.911425:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2349:x1874211690776704:12345-192.168.204.59@tcp:38: 00010000:00080000:1.0:1787387697.911454:0:5807:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:1.0:1787387697.911499:0:5807:0:(genops.c:1406:class_connect()) connect: client d7138a1c-1444-4499-9235-7f89dd5ceb0b, cookie 0x93d41aeaa23c7605 00000004:00100000:1.0:1787387697.911529:0:5807:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:1.0:1787387697.911534:0:5807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787387697.971057:0:5807:0:(import.c:65:import_set_state_nolock()) ffff8d437a718800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387697.971134:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2349:x1874211690776704:12345-192.168.204.59@tcp:38: Request processed in 59707us (59974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387697.971146:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00010000:00010000:3.0:1787387698.526871:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387698.729929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387698.729974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387698.730106:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690776832 00000100:00100000:3.0:1787387698.730116:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690776832 00000100:00100000:3.0:1787387698.730192:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690776960 00000100:00100000:3.0:1787387698.730196:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690776960 00000100:00100000:3.0:1787387698.730218:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1787387698.730228:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:0:x1874211690776832:12345-192.168.204.59@tcp:41: 00000004:00000024:3.0:1787387698.730276:0:6840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787387698.730373:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:0:x1874211690776832:12345-192.168.204.59@tcp:41: Request processed in 145us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387698.730381:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1787387698.730401:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:3.0:1787387698.730408:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:5555:x1874211690776960:12345-192.168.204.59@tcp:41: 00000004:00000024:3.0:1787387698.730420:0:6840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787387698.730440:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:5555:x1874211690776960:12345-192.168.204.59@tcp:41: Request processed in 33us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387698.730447:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00080000:0.0:1787387698.730607:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387698.745219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387698.745893:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690777088 00000100:00100000:3.0:1787387698.745904:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690777088 00000100:00100000:3.0:1787387698.745973:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1787387698.745984:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:5555:x1874211690777088:12345-192.168.204.59@tcp:40: 00000100:00100000:3.0:1787387698.746115:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:5555:x1874211690777088:12345-192.168.204.59@tcp:40: Request processed in 131us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387698.746122:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1787387698.758146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387698.758200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387698.758929:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690777216 00000100:00100000:2.0:1787387698.758941:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690777216 00000100:00100000:2.0:1787387698.758990:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:2.0:1787387698.758999:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1874211690777216:12345-192.168.204.59@tcp:8: 00010000:00080000:2.0:1787387698.759042:0:6604:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1787387698.759087:0:6604:0:(genops.c:1406:class_connect()) connect: client d7138a1c-1444-4499-9235-7f89dd5ceb0b, cookie 0x93d41aeaa23c760c 00002000:00100000:2.0:1787387698.759099:0:6604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d7138a1c-1444-4499-9235-7f89dd5ceb0b/ffff8d42411a7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787387698.759123:0:6604:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1787387698.759514:0:6604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787387698.759547:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d42411a4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387698.759628:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2349:x1874211690777216:12345-192.168.204.59@tcp:8: Request processed in 627us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387698.759635:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:0.0:1787387698.760971:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690777472 00000100:00100000:0.0:1787387698.760983:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690777472 00000100:00100000:0.0:1787387698.761050:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1787387698.761060:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:5555:x1874211690777472:12345-192.168.204.59@tcp:33: 00000100:00100000:3.0:1787387698.767276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387698.767372:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690777344 00000100:00100000:1.0:1787387698.767383:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690777344 00000100:00100000:1.0:1787387698.767434:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1787387698.767444:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874211690777344:12345-192.168.204.59@tcp:8: 00010000:00080000:1.0:1787387698.767476:0:6605:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1787387698.767508:0:6605:0:(genops.c:1406:class_connect()) connect: client d7138a1c-1444-4499-9235-7f89dd5ceb0b, cookie 0x93d41aeaa23c7613 00002000:00100000:1.0:1787387698.767522:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d7138a1c-1444-4499-9235-7f89dd5ceb0b/ffff8d437a71a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787387698.767549:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787387698.767947:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787387698.767981:0:6605:0:(import.c:65:import_set_state_nolock()) ffff8d437a71f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387698.768048:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2349:x1874211690777344:12345-192.168.204.59@tcp:8: Request processed in 604us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387698.768057:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000004:00080000:0.0:1787387698.831320:0:5810:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 70188us 00000004:00200000:0.0:1787387698.870075:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787387698.870277:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:5555:x1874211690777472:12345-192.168.204.59@tcp:33: Request processed in 109213us (112135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387698.870288:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1787387699.164619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387699.164873:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690777600 00000100:00100000:1.0:1787387699.164898:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690777600 00000100:00100000:1.0:1787387699.164960:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:1.0:1787387699.164971:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:5595:x1874211690777600:12345-192.168.204.59@tcp:101: 00010000:00010000:1.0:1787387699.164991:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387699.165088:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5a00/0x93d41aeaa23c761a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52768 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387699.165161:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7621 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387699.165177:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7621 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387699.165193:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7621 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387699.165429:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787387699.165433:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787387699.165509:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7621 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387699.165537:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5a00/0x93d41aeaa23c761a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52768 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387699.165553:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7621 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52768 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387699.165563:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720500) 00010000:00010000:1.0:1787387699.165566:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787387699.165570:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5e00, rc 0) 00000100:00100000:1.0:1787387699.165643:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:5595:x1874211690777600:12345-192.168.204.59@tcp:101: Request processed in 674us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387699.165651:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00010000:00010000:2.0:1787387699.551046:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387699.806081:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387699.806108:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709674240:0@lo:13: 00000100:00100000:2.0:1787387699.806197:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387699.806610:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709674240 00000100:00100000:0.0:1787387699.806617:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709674240 00000100:00100000:0.0:1787387699.806688:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787387699.806698:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709674240:12345-0@lo:13: 00002000:00000024:0.0:1787387699.806720:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387699.806793:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709674240:12345-0@lo:13: Request processed in 98us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387699.806800:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787387699.806864:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787387699.807058:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709674624:0@lo:400: 00000100:00100000:1.0:1787387699.807090:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387699.807109:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387699.807115:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709674496:0@lo:400: 00000100:00100000:1.0:1787387699.807136:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387699.807172:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709674624 00000100:00100000:1.0:1787387699.807176:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709674624 00000100:00100000:1.0:1787387699.807208:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709674496 00000100:00100000:1.0:1787387699.807211:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709674496 00000100:00100000:1.0:1787387699.807226:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787387699.807232:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709674624:12345-0@lo:400: 00000100:00100000:1.0:1787387699.807279:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709674624:12345-0@lo:400: Request processed in 46us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387699.807285:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787387699.807298:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787387699.807303:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709674496:12345-0@lo:400: 00000100:00100000:1.0:1787387699.807557:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709674496:12345-0@lo:400: Request processed in 26us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387699.807565:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787387699.807582:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387699.807610:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709674496:0@lo:400: 00000100:00100000:1.0:1787387699.807622:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709674624:0@lo:400: 00000100:00100000:2.0:1787387699.807716:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709674368:0@lo:400: 00000100:00100000:2.0:1787387699.807771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387699.807808:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709674880:0@lo:400: 00000100:00100000:2.0:1787387699.807840:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787387699.807872:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437f659f80 x1874211709674240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387699.807881:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787387699.807895:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709674240:0@lo:13: 00000100:00100000:3.0:1787387699.807897:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709674752:0@lo:400: 00000100:00100000:2.0:1787387699.807914:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709674880 00000100:00100000:2.0:1787387699.807917:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709674880 00000100:00100000:3.0:1787387699.807928:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387699.807944:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787387699.807951:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709674880:12345-0@lo:400: 00000100:00100000:3.0:1787387699.807955:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709674752 00000100:00100000:3.0:1787387699.807958:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709674752 00000100:00100000:2.0:1787387699.807984:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709674880:12345-0@lo:400: Request processed in 34us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387699.807985:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787387699.807990:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787387699.807991:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709674752:12345-0@lo:400: 00000100:00080000:2.0:1787387699.808003:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387699.808006:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387699.808020:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709674880:0@lo:400: 00000100:00100000:3.0:1787387699.808037:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709674752:12345-0@lo:400: Request processed in 46us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387699.808043:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787387699.808065:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4374177480 x1874211709674752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387699.808075:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709674752:0@lo:400: 00000100:00100000:1.0:1787387699.808200:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709674368 00000100:00100000:1.0:1787387699.808210:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709674368 00000100:00100000:1.0:1787387699.808242:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787387699.808250:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709674368:12345-0@lo:400: 00000100:00100000:1.0:1787387699.808308:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709674368:12345-0@lo:400: Request processed in 59us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387699.808313:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787387699.810427:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709674368:0@lo:400: 00000001:00100000:1.0:1787387700.416165:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00010000:00010000:3.0:1787387700.574037:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387700.830087:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709675008:0@lo:13: 00000100:00100000:2.0:1787387700.830165:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387700.830242:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709675008 00000100:00100000:2.0:1787387700.830250:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709675008 00000100:00100000:2.0:1787387700.830297:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387700.830305:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709675008:12345-0@lo:13: 00002000:00000024:2.0:1787387700.830352:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387700.830397:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709675008:12345-0@lo:13: Request processed in 92us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387700.830405:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787387700.830441:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43747c8a80 x1874211709675008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387700.830460:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709675008:0@lo:13: 00010000:00010000:2.0:1787387701.600132:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387701.753397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387701.753501:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690777728 00000100:00100000:2.0:1787387701.753510:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690777728 00000100:00100000:2.0:1787387701.753596:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:2.0:1787387701.753608:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:5647:x1874211690777728:12345-192.168.204.59@tcp:41: 00000004:00000024:2.0:1787387701.753649:0:5808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787387701.753725:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:5647:x1874211690777728:12345-192.168.204.59@tcp:41: Request processed in 120us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387701.753733:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00080000:1.0:1787387701.754010:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387701.763773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387701.763981:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690777856 00000100:00100000:0.0:1787387701.763991:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690777856 00000100:00100000:0.0:1787387701.764068:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1787387701.764079:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:5647:x1874211690777856:12345-192.168.204.59@tcp:13: 00002000:00000024:0.0:1787387701.764119:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387701.764190:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:5647:x1874211690777856:12345-192.168.204.59@tcp:13: Request processed in 113us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387701.764198:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00080000:1.0:1787387701.764895:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387701.767544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387701.767670:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690777984 00000100:00100000:2.0:1787387701.767686:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690777984 00000100:00100000:2.0:1787387701.767839:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:2.0:1787387701.767852:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:5647:x1874211690777984:12345-192.168.204.59@tcp:13: 00002000:00000024:2.0:1787387701.767903:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387701.767990:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:5647:x1874211690777984:12345-192.168.204.59@tcp:13: Request processed in 141us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387701.767999:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00080000:1.0:1787387701.768403:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1787387702.413542:0:7514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00010000:00010000:3.0:1787387702.622865:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787387703.452704:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00010000:00010000:2.0:1787387703.646085:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387704.251259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387704.251306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387704.251456:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690778112 00000100:00100000:2.0:1787387704.251467:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690778112 00000100:00100000:2.0:1787387704.251519:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:2.0:1787387704.251529:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2353:x1874211690778112:12345-192.168.204.59@tcp:400: 00000100:00100000:2.0:1787387704.251630:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2353:x1874211690778112:12345-192.168.204.59@tcp:400: Request processed in 102us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387704.251638:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:3.0:1787387704.256079:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387704.256143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387704.256232:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690778240 00000100:00100000:2.0:1787387704.256244:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690778240 00000100:00100000:2.0:1787387704.256324:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:2.0:1787387704.256346:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2353:x1874211690778240:12345-192.168.204.59@tcp:400: 00000100:00100000:2.0:1787387704.256435:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2353:x1874211690778240:12345-192.168.204.59@tcp:400: Request processed in 91us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387704.256443:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00080000:1.0:1787387704.258936:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387704.271403:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690778368 00000100:00100000:0.0:1787387704.271421:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690778368 00000100:00100000:0.0:1787387704.271514:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690778496 00000100:00100000:0.0:1787387704.271519:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690778496 00000100:00100000:0.0:1787387704.271557:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:0.0:1787387704.271568:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690778368:12345-192.168.204.59@tcp:400: 00000100:00100000:0.0:1787387704.271688:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690778368:12345-192.168.204.59@tcp:400: Request processed in 120us (20379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387704.271696:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:0.0:1787387704.271713:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1787387704.271720:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690778496:12345-192.168.204.59@tcp:400: 00000100:00100000:0.0:1787387704.271782:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690778496:12345-192.168.204.59@tcp:400: Request processed in 62us (15650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387704.271789:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00080000:1.0:1787387704.272020:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387704.272025:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787387704.669879:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387704.929940:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4346458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709675392:0@lo:400: 00000100:00100000:3.0:1787387704.930012:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387704.930065:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709675904:0@lo:400: 00000100:00100000:3.0:1787387704.930090:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387704.930119:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787387704.930125:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4346459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709675264:0@lo:400: 00000100:00100000:3.0:1787387704.930153:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387704.930182:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709675776:0@lo:400: 00000100:00100000:3.0:1787387704.930204:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387704.930246:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709675392 00000100:00100000:3.0:1787387704.930254:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709675392 00000100:00100000:3.0:1787387704.930297:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709675776 00000100:00100000:3.0:1787387704.930300:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709675776 00000100:00100000:3.0:1787387704.930332:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787387704.930354:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709675392:12345-0@lo:400: 00000100:00100000:3.0:1787387704.930412:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709675392:12345-0@lo:400: Request processed in 58us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387704.930419:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787387704.930438:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787387704.930445:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709675776:12345-0@lo:400: 00000100:00100000:3.0:1787387704.930469:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709675776:12345-0@lo:400: Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387704.930476:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787387704.930515:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709675776:0@lo:400: 00000100:00100000:3.0:1787387704.930525:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4346458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709675392:0@lo:400: 00000100:00100000:1.0:1787387704.931000:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709675904 00000100:00100000:1.0:1787387704.931005:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709675904 00000100:00100000:1.0:1787387704.931051:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787387704.931061:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709675904:12345-0@lo:400: 00000100:00100000:2.0:1787387704.931076:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709675136:0@lo:13: 00000100:00100000:1.0:1787387704.931116:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709675904:12345-0@lo:400: Request processed in 57us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387704.931121:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387704.931129:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387704.931153:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d434645ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709675648:0@lo:400: 00000100:00080000:1.0:1787387704.931153:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387704.931160:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387704.931191:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787387704.931201:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcfb80 x1874211709675904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387704.931214:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387704.931222:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d434645b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709675520:0@lo:400: 00000100:00100000:1.0:1787387704.931227:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709675904:0@lo:400: 00000100:00100000:2.0:1787387704.931257:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387704.931276:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709675264 00000100:00100000:1.0:1787387704.931281:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709675264 00000100:00100000:2.0:1787387704.931301:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709675136 00000100:00100000:2.0:1787387704.931305:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709675136 00000100:00100000:1.0:1787387704.931315:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787387704.931326:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709675264:12345-0@lo:400: 00000100:00100000:2.0:1787387704.931339:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387704.931349:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709675136:12345-0@lo:13: 00000100:00100000:1.0:1787387704.931379:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709675264:12345-0@lo:400: Request processed in 55us (1223us total) trans 0 rc 0/0 00002000:00000024:2.0:1787387704.931385:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387704.931390:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787387704.931423:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709675520 00000100:00100000:1.0:1787387704.931427:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709675520 00000100:00100000:2.0:1787387704.931430:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709675136:12345-0@lo:13: Request processed in 82us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387704.931438:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387704.931459:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709675648 00000100:00100000:1.0:1787387704.931470:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787387704.931477:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709675520:12345-0@lo:400: 00000100:00100000:1.0:1787387704.931511:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709675520:12345-0@lo:400: Request processed in 36us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387704.931518:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787387704.931652:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709675648 00000100:00100000:2.0:1787387704.931689:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387704.931695:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709675648:12345-0@lo:400: 00000100:00100000:2.0:1787387704.931724:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709675648:12345-0@lo:400: Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387704.931764:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387704.931798:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d434645b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709675520:0@lo:400: 00010000:00080000:2.0:1787387704.931812:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4374174a80 x1874211709675136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387704.931826:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709675136:0@lo:13: 00010000:00080000:2.0:1787387704.931836:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d434645ad80 x1874211709675648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787387704.931841:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387704.931847:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387704.931848:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d434645ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709675648:0@lo:400: 00000100:00100000:1.0:1787387704.931876:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4346459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709675264:0@lo:400: 00000001:02000400:1.0:1787387705.492512:0:8170:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787387705.704506:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387705.950894:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387705.950922:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709676032:0@lo:13: 00000100:00100000:3.0:1787387705.950988:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387705.951882:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709676032 00000100:00100000:0.0:1787387705.951892:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709676032 00000100:00100000:0.0:1787387705.951956:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787387705.951965:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709676032:12345-0@lo:13: 00002000:00000024:0.0:1787387705.952005:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387705.952107:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709676032:12345-0@lo:13: Request processed in 143us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387705.952131:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787387705.952425:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43747c8a80 x1874211709676032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387705.952444:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709676032:0@lo:13: 00010000:00010000:3.0:1787387706.717923:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387707.741939:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387708.765979:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387709.356607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387709.356660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387709.356692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387709.356712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387709.356839:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690778752 00000100:00100000:1.0:1787387709.356849:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690778752 00000100:00100000:1.0:1787387709.356916:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:1.0:1787387709.356927:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2352:x1874211690778752:12345-192.168.204.59@tcp:400: 00000100:00100000:1.0:1787387709.357000:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2352:x1874211690778752:12345-192.168.204.59@tcp:400: Request processed in 75us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387709.357008:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:1.0:1787387709.357029:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690778624 00000100:00100000:1.0:1787387709.357032:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690778624 00000100:00100000:1.0:1787387709.357084:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:1.0:1787387709.357090:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2352:x1874211690778624:12345-192.168.204.59@tcp:400: 00000100:00100000:1.0:1787387709.357117:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2352:x1874211690778624:12345-192.168.204.59@tcp:400: Request processed in 27us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387709.357123:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:1.0:1787387709.357149:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690779008 00000100:00100000:1.0:1787387709.357153:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690779008 00000100:00100000:1.0:1787387709.357187:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690778880 00000100:00100000:1.0:1787387709.357191:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690778880 00000100:00100000:1.0:1787387709.357204:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1787387709.357211:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690779008:12345-192.168.204.59@tcp:400: 00000100:00100000:1.0:1787387709.357235:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690779008:12345-192.168.204.59@tcp:400: Request processed in 25us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387709.357241:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1787387709.357252:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:1.0:1787387709.357258:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690778880:12345-192.168.204.59@tcp:400: 00000100:00100000:1.0:1787387709.357278:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690778880:12345-192.168.204.59@tcp:400: Request processed in 20us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387709.357284:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00080000:3.0:1787387709.357689:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387709.357695:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787387709.357698:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787387709.789955:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387710.047013:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709676160:0@lo:13: 00000100:00100000:1.0:1787387710.047073:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387710.047150:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709676160 00000100:00100000:1.0:1787387710.047156:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709676160 00000100:00100000:1.0:1787387710.047219:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787387710.047229:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709676160:12345-0@lo:13: 00002000:00000024:1.0:1787387710.047273:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387710.047318:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709676160:12345-0@lo:13: Request processed in 90us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387710.047325:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787387710.047343:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787387710.047370:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4374176d80 x1874211709676160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387710.047389:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709676160:0@lo:13: 00000100:00100000:1.0:1787387710.047621:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709676288:0@lo:400: 00000100:00100000:1.0:1787387710.047660:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387710.048998:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709676800:0@lo:400: 00000100:00100000:1.0:1787387710.049043:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387710.049067:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387710.049073:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709676416:0@lo:400: 00000100:00100000:1.0:1787387710.049092:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387710.049124:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709676800 00000100:00100000:1.0:1787387710.049130:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709676800 00000100:00100000:1.0:1787387710.049188:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709676416 00000100:00100000:1.0:1787387710.049191:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709676416 00000100:00100000:1.0:1787387710.049211:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387710.049219:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709676800:12345-0@lo:400: 00000100:00100000:1.0:1787387710.049265:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709676800:12345-0@lo:400: Request processed in 46us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387710.049272:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387710.049288:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787387710.049294:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709676416:12345-0@lo:400: 00000100:00100000:1.0:1787387710.049330:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709676416:12345-0@lo:400: Request processed in 36us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387710.049337:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787387710.049361:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387710.049373:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709676544:0@lo:400: 00000100:00100000:1.0:1787387710.049398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387710.049416:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387710.049422:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709676672:0@lo:400: 00000100:00100000:1.0:1787387710.049444:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387710.049466:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709676672 00000100:00100000:1.0:1787387710.049469:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709676672 00000100:00100000:1.0:1787387710.049499:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787387710.049505:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709676672:12345-0@lo:400: 00000100:00100000:1.0:1787387710.049537:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709676672:12345-0@lo:400: Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387710.049542:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787387710.049558:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787387710.049592:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4377c07480 x1874211709676672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387710.049605:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709676672:0@lo:400: 00000100:00100000:1.0:1787387710.049637:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709676544 00000100:00100000:1.0:1787387710.049640:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709676544 00000100:00100000:1.0:1787387710.049662:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787387710.049666:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709676544:12345-0@lo:400: 00000100:00100000:1.0:1787387710.049697:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709676544:12345-0@lo:400: Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387710.049713:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787387710.049728:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387710.049761:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709676544:0@lo:400: 00000100:00100000:1.0:1787387710.049784:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709676416:0@lo:400: 00000100:00100000:1.0:1787387710.049792:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709676800:0@lo:400: 00000100:00100000:2.0:1787387710.050802:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709676288 00000100:00100000:2.0:1787387710.050809:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709676288 00000100:00100000:2.0:1787387710.050842:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787387710.050848:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709676288:12345-0@lo:400: 00000100:00100000:2.0:1787387710.051916:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709676288:12345-0@lo:400: Request processed in 1065us (4253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387710.051931:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787387710.052076:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709676288:0@lo:400: 00000020:00000080:1.0:1787387710.073306:0:8319:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffefebc0b60 00000020:00000080:1.0:1787387710.073322:0:8319:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787387710.073326:0:8319:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787387710.073333:0:8319:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefebc2df0 20000000:00000080:1.0:1787387710.073340:0:8319:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d437f77d400 uarg=0000000000000000 20000000:01000000:1.0:1787387710.073377:0:8319:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787387710.073379:0:8319:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787387710.073381:0:8319:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787387710.073387:0:8319:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787387710.073392:0:8319:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787387710.073406:0:8319:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787387710.073408:0:8319:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787387710.073593:0:8319:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787387710.073597:0:8319:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787387710.076482:0:8320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787387710.077069:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787387710.077137:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787387710.077188:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1787387710.077202:0:8319:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787387710.077205:0:8319:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787387710.078145:0:8321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787387710.078567:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787387710.078613:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787387710.078662:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787387710.078675:0:8319:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787387710.078683:0:8319:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787387710.079575:0:8322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787387710.081486:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787387710.081542:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787387710.081602:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787387710.081620:0:8319:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787387710.081623:0:8319:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787387710.082676:0:8323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787387710.083120:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787387710.083258:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787387710.083298:0:8319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1787387710.083315:0:8319:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787387710.083391:0:8319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083411:0:8319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c7525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c751e expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083420:0:8319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c754f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7548 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083427:0:8319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c7579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7572 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083434:0:8319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c7587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7580 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083441:0:8319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c7595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c758e expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083446:0:8319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c75b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c75aa expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083451:0:8319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c75db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c75d4 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083460:0:8319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c75e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52706 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083479:0:8319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4242f90600/0x93d41aeaa23c75f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5270d expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083486:0:8319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083523:0:8319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4242f90600/0x93d41aeaa23c75f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5270d expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083540:0:8319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4242f90600/0x93d41aeaa23c75f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5270d expref: 9 pid: 5800 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387710.083555:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d434645ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709676928:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387710.083853:0:8319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c75e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52706 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083873:0:8319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c75e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52706 expref: 9 pid: 5800 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387710.083882:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d434645b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677056:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387710.083915:0:8319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c75db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c75d4 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.083923:0:8319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c75db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c75d4 expref: 18 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387710.083932:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4346458700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677184:0@lo:104: 00000100:00100000:3.0:1787387710.083983:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387710.084027:0:8319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c75b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c75aa expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.084036:0:8319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c75b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c75aa expref: 18 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387710.084043:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677312:0@lo:104: 00000100:00100000:3.0:1787387710.084065:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387710.084084:0:8319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c7595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c758e expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.084091:0:8319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c7595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c758e expref: 18 pid: 5801 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387710.084098:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5daa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677440:0@lo:104: 00010000:00010000:3.0:1787387710.084122:0:8319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c7587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c7580 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.084128:0:8319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c7587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c7580 expref: 18 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387710.084134:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677568:0@lo:104: 00010000:00010000:3.0:1787387710.084155:0:8319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c7579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c7572 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.084350:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787387710.084368:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387710.084380:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387710.084387:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709677184 00000100:00100000:2.0:1787387710.084393:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709677184 00000100:00100000:2.0:1787387710.084426:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709677312 00000100:00100000:2.0:1787387710.084429:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709677312 00000100:00100000:2.0:1787387710.084438:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709677440 00000100:00100000:2.0:1787387710.084440:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709677440 00000100:00100000:2.0:1787387710.084448:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709677568 00000100:00100000:2.0:1787387710.084450:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709677568 00000100:00100000:2.0:1787387710.084462:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387710.084469:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+6:8319:x1874211709677184:12345-0@lo:104: 00010000:00010000:2.0:1787387710.084481:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.084528:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387710.084534:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+6:8319:x1874211709677184:12345-0@lo:104: Request processed in 66us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387710.084547:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387710.084563:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387710.084568:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437395fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:8319:x1874211709677312:12345-0@lo:104: 00010000:00010000:2.0:1787387710.084575:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.084612:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787387710.084617:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437395fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:8319:x1874211709677312:12345-0@lo:104: Request processed in 50us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387710.084622:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387710.084666:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387710.084672:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:8319:x1874211709677440:12345-0@lo:104: 00010000:00010000:2.0:1787387710.084679:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.084702:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787387710.084706:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:8319:x1874211709677440:12345-0@lo:104: Request processed in 35us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387710.084712:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387710.084723:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387710.084728:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:8319:x1874211709677568:12345-0@lo:104: 00010000:00010000:2.0:1787387710.084735:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.084784:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787387710.084789:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:8319:x1874211709677568:12345-0@lo:104: Request processed in 61us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387710.084799:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787387710.084817:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787387710.084823:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.084829:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91c00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:2.0:1787387710.084834:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.084842:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387710.084849:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387710.084855:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387710.084896:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.084903:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387710.084923:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.084930:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4242f91c00/0x93d41aeaa23c75d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c75db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.084942:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787387710.084945:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.084962:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91400 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:2.0:1787387710.084966:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.084972:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387710.084979:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387710.084984:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387710.084998:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085004:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387710.085020:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085027:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c75aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c75b1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085035:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387710.085037:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085043:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90200 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:2.0:1787387710.085046:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085061:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387710.085067:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387710.085072:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387710.085085:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085090:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387710.085095:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085102:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c758e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7595 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085111:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387710.085114:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085119:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd200 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:2.0:1787387710.085122:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085128:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387710.085134:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387710.085144:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387710.085157:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085294:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387710.085301:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085307:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c7580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7587 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.085317:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387710.085319:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387710.085320:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387710.085328:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387710.085350:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709677824:0@lo:103: 00000100:00100000:2.0:1787387710.085382:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387710.085415:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387710.085421:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709678208:0@lo:103: 00000100:00100000:2.0:1787387710.085440:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387710.085465:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709677952:0@lo:103: 00000100:00100000:2.0:1787387710.085484:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387710.085498:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387710.085503:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709678080:0@lo:103: 00000100:00100000:2.0:1787387710.085519:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387710.085540:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709677824 00000100:00100000:2.0:1787387710.085545:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709677824 00010000:00010000:2.0:1787387710.085573:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c75db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c75d4 expref: 19 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.085590:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709678208 00000100:00100000:2.0:1787387710.085593:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709678208 00010000:00010000:2.0:1787387710.085601:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c7587 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7580 expref: 20 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.085611:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709677952 00000100:00100000:2.0:1787387710.085613:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709677952 00010000:00010000:2.0:1787387710.085622:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c75b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c75aa expref: 21 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.085646:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709678080 00000100:00100000:2.0:1787387710.085649:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709678080 00010000:00010000:2.0:1787387710.085658:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c7595 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c758e expref: 22 pid: 5801 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.085669:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387710.085675:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+22:3312:x1874211709677824:12345-0@lo:103: 00010000:00010000:2.0:1787387710.085686:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387710.085690:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c75db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c75d4 expref: 22 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.085838:0:8319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c7579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c7572 expref: 22 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387710.085849:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677696:0@lo:104: 00000100:00100000:3.0:1787387710.085946:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387710.086011:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709677696 00000100:00100000:1.0:1787387710.086015:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709677696 00000100:00100000:1.0:1787387710.086041:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787387710.086048:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:8319:x1874211709677696:12345-0@lo:104: 00010000:00010000:1.0:1787387710.086056:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.086092:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787387710.086104:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:8319:x1874211709677696:12345-0@lo:104: Request processed in 57us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387710.086111:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787387710.086185:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c75db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c75d4 expref: 22 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086206:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387710.086243:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+22:3312:x1874211709677824:12345-0@lo:103: Request processed in 567us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387710.086250:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387710.086268:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387710.086274:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+21:3312:x1874211709678208:12345-0@lo:103: 00010000:00010000:2.0:1787387710.086282:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387710.086287:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c7587 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7580 expref: 21 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086295:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c7587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c7580 expref: 21 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086305:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387710.086326:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+21:3312:x1874211709678208:12345-0@lo:103: Request processed in 52us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387710.086331:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387710.086342:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387710.086348:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+20:3313:x1874211709677952:12345-0@lo:103: 00010000:00010000:2.0:1787387710.086355:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387710.086358:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c75b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c75aa expref: 20 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086366:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c75b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c75aa expref: 20 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086375:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387710.086399:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+20:3313:x1874211709677952:12345-0@lo:103: Request processed in 52us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387710.086404:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387710.086417:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387710.086423:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709678080:12345-0@lo:103: 00010000:00010000:2.0:1787387710.086431:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387710.086441:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c7595 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c758e expref: 19 pid: 5801 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086449:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c7595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c758e expref: 19 pid: 5801 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086459:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387710.086481:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709678080:12345-0@lo:103: Request processed in 59us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387710.086486:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387710.086530:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709678080:0@lo:103: 00000100:00100000:2.0:1787387710.086539:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709677952:0@lo:103: 00010000:00010000:2.0:1787387710.086560:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387710.086565:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086571:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4200 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:2.0:1787387710.086575:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086582:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387710.086589:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387710.086594:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387710.086617:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086647:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387710.086660:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086667:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4200/0x93d41aeaa23c7572 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7579 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086678:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387710.086680:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387710.086682:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387710.086689:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387710.086699:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709678336:0@lo:103: 00000100:00100000:2.0:1787387710.086724:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387710.086781:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709678336 00000100:00100000:2.0:1787387710.086786:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709678336 00010000:00010000:2.0:1787387710.086800:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c7579 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7572 expref: 19 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.086817:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387710.086822:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709678336:12345-0@lo:103: 00010000:00010000:2.0:1787387710.086829:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387710.086833:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c7579 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7572 expref: 19 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086840:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c7579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c7572 expref: 19 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.086850:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387710.087078:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709678336:12345-0@lo:103: Request processed in 254us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387710.087089:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387710.087115:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709678336:0@lo:103: 00000100:00100000:1.0:1787387710.087419:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709678208:0@lo:103: 00000100:00100000:1.0:1787387710.087427:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709677824:0@lo:103: 00010000:00010000:2.0:1787387710.088096:0:8319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c754f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c7548 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.088108:0:8319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c754f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c7548 expref: 18 pid: 5801 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.088119:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709678464:0@lo:104: 00000100:00100000:2.0:1787387710.088151:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787387710.088289:0:8319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c7525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c751e expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.088297:0:8319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c7525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c751e expref: 18 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.088305:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709678592:0@lo:104: 00000100:00100000:2.0:1787387710.088336:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387710.088449:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a700b40 going to sleep for 11 seconds 00010000:00010000:2.0:1787387710.088465:0:8319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c75db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c75d4 expref: 18 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.088477:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4346458700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677184:0@lo:104: 00010000:00010000:2.0:1787387710.088486:0:8319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c75b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c75aa expref: 17 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.088494:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677312:0@lo:104: 00010000:00010000:2.0:1787387710.088502:0:8319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c7595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c758e expref: 16 pid: 5801 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.088521:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5daa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677440:0@lo:104: 00010000:00010000:2.0:1787387710.088533:0:8319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c7587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c7580 expref: 15 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.088541:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677568:0@lo:104: 00010000:00010000:2.0:1787387710.088550:0:8319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43413fda00/0x93d41aeaa23c7579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c7572 expref: 14 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.088558:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677696:0@lo:104: 00000100:00100000:1.0:1787387710.088657:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709678464 00000100:00100000:1.0:1787387710.088663:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709678464 00000100:00100000:1.0:1787387710.088691:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709678592 00000100:00100000:1.0:1787387710.088694:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709678592 00000100:00100000:1.0:1787387710.088706:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787387710.088713:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:8319:x1874211709678464:12345-0@lo:104: 00010000:00010000:1.0:1787387710.088723:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.088800:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787387710.088806:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:8319:x1874211709678464:12345-0@lo:104: Request processed in 93us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387710.088812:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787387710.088828:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787387710.088833:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:8319:x1874211709678592:12345-0@lo:104: 00010000:00010000:1.0:1787387710.088840:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.088884:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787387710.088889:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:8319:x1874211709678592:12345-0@lo:104: Request processed in 56us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387710.088894:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787387710.088917:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787387710.088922:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.088929:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030400 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387710.088933:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.088940:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387710.088946:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387710.088952:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387710.088977:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.088983:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387710.088999:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.089005:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7548 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c754f expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.089015:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387710.089018:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.089024:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4800 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387710.089027:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.089039:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387710.089044:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387710.089049:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387710.089062:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.089066:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387710.089071:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.089077:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c751e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7525 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.089089:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387710.089091:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387710.089092:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387710.089109:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709678720:0@lo:103: 00000100:00100000:1.0:1787387710.089134:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387710.089153:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387710.089300:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709678848:0@lo:103: 00000100:00100000:1.0:1787387710.089388:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387710.089422:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709678720 00000100:00100000:1.0:1787387710.089427:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709678720 00010000:00010000:1.0:1787387710.089443:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c754f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7548 expref: 14 pid: 5801 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387710.089472:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709678848 00000100:00100000:1.0:1787387710.089475:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709678848 00010000:00010000:1.0:1787387710.089486:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c7525 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c751e expref: 15 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387710.089497:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787387710.089503:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:3313:x1874211709678720:12345-0@lo:103: 00010000:00010000:1.0:1787387710.089511:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387710.089516:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c754f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7548 expref: 15 pid: 5801 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.089525:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c754f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c7548 expref: 15 pid: 5801 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.089539:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387710.089566:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:3313:x1874211709678720:12345-0@lo:103: Request processed in 63us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387710.089571:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787387710.089582:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787387710.089588:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434643d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:3313:x1874211709678848:12345-0@lo:103: 00010000:00010000:1.0:1787387710.089595:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387710.089600:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c7525 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c751e expref: 14 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.089608:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c7525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c751e expref: 14 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.089617:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387710.089681:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434643d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:3313:x1874211709678848:12345-0@lo:103: Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387710.089687:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787387710.089735:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709678848:0@lo:103: 00000100:00100000:1.0:1787387710.089763:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709678720:0@lo:103: 00010000:00010000:2.0:1787387710.089866:0:8319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c754f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c7548 expref: 13 pid: 5801 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.089877:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709678464:0@lo:104: 00010000:00010000:2.0:1787387710.089886:0:8319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c7525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c751e expref: 12 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387710.089893:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709678592:0@lo:104: 00010000:00010000:0.0:1787387710.089995:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387710.092117:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d434645ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709676928:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387710.092132:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d434645b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8319:1874211709677056:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387710.092251:0:8319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387710.095507:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387710.095553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387710.098597:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690779264 00000100:00100000:0.0:1787387710.098612:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690779264 00010000:00010000:0.0:1787387710.098671:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c75e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52706 expref: 10 pid: 5800 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387710.098713:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690779136 00000100:00100000:0.0:1787387710.098717:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690779136 00000100:00100000:3.0:1787387710.098735:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00010000:00010000:0.0:1787387710.098735:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4242f90600/0x93d41aeaa23c75f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5270d expref: 11 pid: 5800 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387710.098770:0:5794:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787387710.098779:0:5794:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787387710.098887:0:5792:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787387710.098899:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1787387710.098910:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:2351:x1874211690779136:12345-192.168.204.59@tcp:103: 00010000:00010000:1.0:1787387710.098926:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387710.098933:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4242f90600/0x93d41aeaa23c75f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5270d expref: 11 pid: 5800 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.098946:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4242f90600/0x93d41aeaa23c75f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5270d expref: 11 pid: 5800 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.098964:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f90600/0x93d41aeaa23c75f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5270d expref: 11 pid: 5800 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.098979:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387710.099034:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690779136:12345-192.168.204.59@tcp:103: Request processed in 127us (3480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387710.099041:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:3.0:1787387710.101497:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:2351:x1874211690779264:12345-192.168.204.59@tcp:103: 00010000:00010000:3.0:1787387710.101517:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387710.101527:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c75e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52706 expref: 9 pid: 5800 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101544:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c75e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52706 expref: 9 pid: 5800 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101562:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c75e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52706 expref: 9 pid: 5800 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101575:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101584:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101601:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101608:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101616:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101622:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101637:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152fa00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387710.101655:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101664:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101688:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387710.101700:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787387710.101716:0:8319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387710.101727:0:8319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387710.101769:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+8:2351:x1874211690779264:12345-192.168.204.59@tcp:103: Request processed in 286us (6270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387710.101780:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00010000:00010000:2.0:1787387710.101782:0:8319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c7628 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387710.814075:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387711.071220:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387711.071247:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709678976:0@lo:13: 00000100:00100000:1.0:1787387711.071332:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387711.071581:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709678976 00000100:00100000:0.0:1787387711.071590:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709678976 00000100:00100000:0.0:1787387711.071658:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787387711.071668:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709678976:12345-0@lo:13: 00002000:00000024:0.0:1787387711.071707:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387711.071795:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709678976:12345-0@lo:13: Request processed in 129us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387711.071803:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787387711.071898:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43747c9c00 x1874211709678976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387711.071916:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709678976:0@lo:13: 10000000:01000000:1.0:1787387711.133899:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787387711.133907:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4377c90800 from 39 10000000:01000000:1.0:1787387711.133912:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387711.133964:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.133976:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.133986:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387711.134012:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709679104:0@lo:101: 00000100:00100000:1.0:1787387711.134083:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.134236:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709679104 00000100:00100000:2.0:1787387711.134245:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709679104 00000100:00100000:2.0:1787387711.134304:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787387711.134314:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+12:5804:x1874211709679104:12345-0@lo:101: 00010000:00010000:2.0:1787387711.134327:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387711.134341:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c7636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c762f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.134364:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c7636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c762f expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.134374:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c7636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c762f expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.134383:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91200, rc 0) 00000100:00100000:2.0:1787387711.134420:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:5804:x1874211709679104:12345-0@lo:101: Request processed in 108us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387711.134426:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787387711.134774:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f02e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.134799:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709679104:0@lo:101: 00010000:00010000:1.0:1787387711.134813:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.134822:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387711.134873:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709679232:0@lo:501: 00000100:00100000:1.0:1787387711.134898:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.134958:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709679232 00000100:00100000:2.0:1787387711.134963:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709679232 00000100:00100000:2.0:1787387711.134986:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787387711.134993:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:5804:x1874211709679232:12345-0@lo:501: 00000100:00100000:2.0:1787387711.135243:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:5804:x1874211709679232:12345-0@lo:501: Request processed in 249us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387711.135260:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787387711.137509:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f02e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.137728:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709679232:0@lo:501: 00000100:00100000:1.0:1787387711.137806:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709679360:0@lo:503: 00000100:00100000:1.0:1787387711.137948:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387711.138041:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f02e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387711.141944:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709679360 00000100:00100000:2.0:1787387711.141962:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709679360 00000100:00100000:2.0:1787387711.142036:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787387711.142047:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:5804:x1874211709679360:12345-0@lo:503: 00000100:00100000:2.0:1787387711.142312:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:5804:x1874211709679360:12345-0@lo:503: Request processed in 267us (4364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387711.142320:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787387711.142597:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709679360:0@lo:503: 00000100:00100000:1.0:1787387711.146437:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8336:1874211709679488:0@lo:502: 00000100:00100000:1.0:1787387711.146538:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387711.146592:0:8336:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f02d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387711.146730:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709679488 00000100:00100000:0.0:1787387711.146756:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709679488 00000100:00100000:0.0:1787387711.146804:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787387711.146826:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:8336:x1874211709679488:12345-0@lo:502: 00000100:00100000:0.0:1787387711.147057:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:8336:x1874211709679488:12345-0@lo:502: Request processed in 244us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387711.147072:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787387711.147349:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8336:1874211709679488:0@lo:502: 00000100:00100000:1.0:1787387711.147392:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8336:1874211709679616:0@lo:502: 00000100:00100000:1.0:1787387711.147426:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387711.147469:0:8336:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a2a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787387711.147586:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709679616 00000100:00100000:3.0:1787387711.147590:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709679616 00000100:00100000:3.0:1787387711.147630:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787387711.147641:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:8336:x1874211709679616:12345-0@lo:502: 00000100:00100000:3.0:1787387711.147934:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:8336:x1874211709679616:12345-0@lo:502: Request processed in 171us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387711.147943:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787387711.148178:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8336:1874211709679616:0@lo:502: 00000040:00080000:1.0:1787387711.148198:0:8336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787387711.148554:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787387711.148575:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387711.148585:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.148595:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387711.148617:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787387711.148620:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787387711.148623:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787387711.148649:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.148657:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.148666:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387711.148679:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709679744:0@lo:101: 00000100:00100000:2.0:1787387711.148720:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.148780:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1180 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.148865:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709679744 00000100:00100000:1.0:1787387711.148870:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709679744 00000100:00100000:1.0:1787387711.148907:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787387711.148915:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+13:5804:x1874211709679744:12345-0@lo:101: 00010000:00010000:1.0:1787387711.148924:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387711.148937:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4342ad5800/0x93d41aeaa23c7644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c763d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.148957:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad5800/0x93d41aeaa23c7644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c763d expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.148968:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4342ad5800/0x93d41aeaa23c7644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c763d expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.148976:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5800, rc 0) 00000100:00100000:1.0:1787387711.149022:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709679744:12345-0@lo:101: Request processed in 108us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387711.149028:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787387711.149315:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709679744:0@lo:101: 00010000:00010000:2.0:1787387711.149329:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.149337:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387711.149380:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709679872:0@lo:501: 00000100:00100000:2.0:1787387711.149404:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.149426:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787387711.149485:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709679872 00000100:00100000:0.0:1787387711.149489:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709679872 00000100:00100000:0.0:1787387711.149519:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787387711.149527:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709679872:12345-0@lo:501: 00000100:00100000:0.0:1787387711.149797:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709679872:12345-0@lo:501: Request processed in 270us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387711.149804:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787387711.150126:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709679872:0@lo:501: 00000100:00100000:2.0:1787387711.150158:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709680000:0@lo:503: 00000100:00100000:2.0:1787387711.150194:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.150219:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787387711.150276:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709680000 00000100:00100000:0.0:1787387711.150281:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709680000 00000100:00100000:0.0:1787387711.150297:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787387711.150303:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709680000:12345-0@lo:503: 00000100:00100000:0.0:1787387711.150447:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709680000:12345-0@lo:503: Request processed in 144us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387711.150463:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787387711.150653:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709680000:0@lo:503: 00000100:00100000:3.0:1787387711.152254:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8337:1874211709680128:0@lo:502: 00000100:00100000:3.0:1787387711.152323:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387711.152363:0:8337:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a700780 going to sleep for 11 seconds 00000100:00100000:0.0:1787387711.152427:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709680128 00000100:00100000:0.0:1787387711.152434:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709680128 00000100:00100000:0.0:1787387711.152489:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787387711.152498:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:8337:x1874211709680128:12345-0@lo:502: 00000100:00100000:0.0:1787387711.153134:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:8337:x1874211709680128:12345-0@lo:502: Request processed in 635us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387711.153142:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787387711.160007:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8337:1874211709680128:0@lo:502: 00000020:01000000:3.0:1787387711.160063:0:8337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387711.160088:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387711.160090:0:8337:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787387711.160097:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787387711.160138:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8337:1874211709680256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387711.160210:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387711.160253:0:8337:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a700780 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.160368:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709680256 00000100:00100000:1.0:1787387711.160375:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709680256 00000100:00100000:1.0:1787387711.160426:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787387711.160435:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:8337:x1874211709680256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387711.160703:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:8337:x1874211709680256:12345-0@lo:502:llog_process_th.0 Request processed in 268us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387711.160711:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787387711.165322:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8337:1874211709680256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387711.165371:0:8337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387711.165383:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387711.165385:0:8337:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787387711.165389:0:8337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787387711.166322:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787387711.166349:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787387711.166360:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.166370:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387711.166380:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787387711.166382:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4379110800 from 39 10000000:01000000:1.0:1787387711.166385:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387711.166423:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.166431:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.166440:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387711.166490:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709680384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787387711.166555:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387711.166599:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a2a1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787387711.166731:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709680384 00000100:00100000:0.0:1787387711.166764:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709680384 00000100:00100000:0.0:1787387711.166826:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787387711.166836:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:5804:x1874211709680384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387711.166857:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387711.166869:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4340031600/0x93d41aeaa23c7652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c764b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387711.166891:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340031600/0x93d41aeaa23c7652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c764b expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387711.166900:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4340031600/0x93d41aeaa23c7652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c764b expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387711.166909:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340031600, rc 0) 00000100:00100000:0.0:1787387711.166961:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709680384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387711.166968:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787387711.167304:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709680384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387711.167320:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.167328:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387711.167381:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709680512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387711.167422:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.167465:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1180 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.170351:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709680512 00000100:00100000:1.0:1787387711.170366:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709680512 00000100:00100000:1.0:1787387711.170422:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787387711.170431:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709680512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387711.171593:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709680512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1158us (4165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387711.171619:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787387711.177199:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709680512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387711.177275:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709680640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387711.177358:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387711.177398:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4345c0b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787387711.177512:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709680640 00000100:00100000:2.0:1787387711.177519:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709680640 00000100:00100000:2.0:1787387711.177583:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787387711.177592:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709680640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387711.178042:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709680640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 450us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387711.178051:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787387711.178506:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709680640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387711.179380:0:8338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8338:1874211709680768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387711.179436:0:8338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387711.179481:0:8338:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4345c0b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387711.180009:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709680768 00000100:00100000:2.0:1787387711.180017:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709680768 00000100:00100000:2.0:1787387711.180066:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787387711.180077:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:8338:x1874211709680768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387711.180393:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:8338:x1874211709680768:12345-0@lo:502:llog_process_th.0 Request processed in 317us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387711.180401:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787387711.183767:0:8338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8338:1874211709680768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387711.183891:0:8338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8338:1874211709680896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387711.183968:0:8338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387711.184017:0:8338:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4345c0b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387711.184228:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709680896 00000100:00100000:2.0:1787387711.184235:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709680896 00000100:00100000:2.0:1787387711.184287:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787387711.184296:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:8338:x1874211709680896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387711.184565:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:8338:x1874211709680896:12345-0@lo:502:llog_process_th.0 Request processed in 268us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387711.184572:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787387711.185362:0:8338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8338:1874211709680896:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787387711.185393:0:8338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787387711.185930:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787387711.185954:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387711.185965:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.185989:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387711.185999:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787387711.186001:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787387711.186004:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787387711.186038:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.186046:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.186054:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387711.186073:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387711.186125:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.186170:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387711.186239:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709681024 00000100:00100000:0.0:1787387711.186246:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709681024 00000100:00100000:0.0:1787387711.186291:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787387711.186300:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:5804:x1874211709681024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387711.186320:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387711.186333:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c7660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7659 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387711.186356:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c7660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7659 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387711.186367:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c7660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7659 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387711.186375:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340031000, rc 0) 00000100:00100000:0.0:1787387711.186422:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709681024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387711.186428:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787387711.186573:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387711.186587:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387711.186596:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387711.186652:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387711.186677:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387711.186699:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a700300 going to sleep for 11 seconds 00000100:00100000:0.0:1787387711.186959:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709681152 00000100:00100000:0.0:1787387711.186964:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709681152 00000100:00100000:0.0:1787387711.186987:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787387711.186994:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709681152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387711.187228:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709681152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387711.187235:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787387711.187329:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387711.187360:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387711.187396:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387711.187422:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a700300 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.187477:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709681280 00000100:00100000:1.0:1787387711.187481:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709681280 00000100:00100000:1.0:1787387711.187501:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787387711.187507:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709681280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387711.187675:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709681280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387711.187682:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787387711.187860:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387711.188333:0:8339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8339:1874211709681408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387711.188372:0:8339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387711.188401:0:8339:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a700780 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.188440:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709681408 00000100:00100000:1.0:1787387711.188445:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709681408 00000100:00100000:1.0:1787387711.188489:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787387711.188496:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:8339:x1874211709681408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387711.189068:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:8339:x1874211709681408:12345-0@lo:502:llog_process_th.0 Request processed in 570us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387711.189076:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787387711.189153:0:8339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8339:1874211709681408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387711.189178:0:8339:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387711.189187:0:8339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387711.189189:0:8339:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787387711.189195:0:8339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787387711.189218:0:8339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8339:1874211709681536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387711.189253:0:8339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387711.189280:0:8339:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a700780 going to sleep for 11 seconds 00000100:00100000:2.0:1787387711.189341:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709681536 00000100:00100000:2.0:1787387711.189346:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709681536 00000100:00100000:2.0:1787387711.189367:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787387711.189373:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:8339:x1874211709681536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387711.189819:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:8339:x1874211709681536:12345-0@lo:502:llog_process_th.0 Request processed in 436us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387711.189827:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787387711.194126:0:8339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8339:1874211709681536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387711.194177:0:8339:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387711.194187:0:8339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387711.194189:0:8339:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787387711.194194:0:8339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787387711.194385:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787387711.194405:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787387711.194416:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.194426:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387711.194435:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787387711.194438:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4350ce4000 from 39 10000000:01000000:1.0:1787387711.194441:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387711.194486:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.194493:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.194501:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387711.194523:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787387711.194595:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387711.195034:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f02d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387711.195102:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709681664 00000100:00100000:2.0:1787387711.195109:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709681664 00000100:00100000:2.0:1787387711.195158:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787387711.195174:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709681664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387711.195191:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387711.195210:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f91c00/0x93d41aeaa23c766e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7667 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.195238:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f91c00/0x93d41aeaa23c766e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7667 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.195250:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f91c00/0x93d41aeaa23c766e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7667 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.195260:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91c00, rc 0) 00000100:00100000:2.0:1787387711.195320:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709681664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387711.195327:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787387711.195523:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387711.195541:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387711.195998:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387711.196184:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387711.196218:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.196253:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4344e84480 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.196300:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709681792 00000100:00100000:1.0:1787387711.196306:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709681792 00000100:00100000:1.0:1787387711.196341:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787387711.196350:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709681792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387711.197473:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709681792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1120us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387711.197483:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787387711.199291:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387711.199441:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387711.199525:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387711.199629:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754780 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.206156:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709681920 00000100:00100000:1.0:1787387711.206173:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709681920 00000100:00100000:0.0:1787387711.206307:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787387711.206317:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709681920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387711.206787:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709681920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 470us (7261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387711.206803:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787387711.206955:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709681920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387711.207414:0:8340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c06d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8340:1874211709682048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387711.207475:0:8340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.207511:0:8340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.207670:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709682048 00000100:00100000:1.0:1787387711.207676:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709682048 00000100:00100000:1.0:1787387711.207715:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787387711.207723:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:8340:x1874211709682048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387711.208121:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:8340:x1874211709682048:12345-0@lo:502:llog_process_th.0 Request processed in 398us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387711.208128:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787387711.208202:0:8340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c06d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8340:1874211709682048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387711.208254:0:8340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8340:1874211709682176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387711.208288:0:8340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387711.208315:0:8340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a700780 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.208356:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709682176 00000100:00100000:1.0:1787387711.208360:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709682176 00000100:00100000:1.0:1787387711.208421:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787387711.208428:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:8340:x1874211709682176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387711.208579:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:8340:x1874211709682176:12345-0@lo:502:llog_process_th.0 Request processed in 151us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387711.208586:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787387711.228329:0:8340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8340:1874211709682176:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787387711.228376:0:8340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787387711.230976:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787387711.231018:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387711.231032:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.231069:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387711.231081:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787387711.231084:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787387711.231087:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787387711.231124:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.231132:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.231142:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387711.231166:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709682304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387711.231234:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.231328:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787387711.235908:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709682304 00000100:00100000:3.0:1787387711.235929:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709682304 00000100:00100000:3.0:1787387711.236035:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787387711.236046:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709682304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387711.236064:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387711.236084:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c767c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7675 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387711.236114:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c767c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7675 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387711.236126:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c767c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7675 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387711.236134:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f200, rc 0) 00000100:00100000:3.0:1787387711.236294:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709682304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (5058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387711.236301:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787387711.245955:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709682304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387711.245986:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.245999:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387711.246082:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709682432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387711.246139:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.246194:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787387711.246289:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709682432 00000100:00100000:0.0:1787387711.246297:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709682432 00000100:00100000:0.0:1787387711.246347:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787387711.246356:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709682432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387711.246647:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709682432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387711.246656:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787387711.246925:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709682432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387711.246958:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709682560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387711.246998:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.247028:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.247092:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709682560 00000100:00100000:1.0:1787387711.247097:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709682560 00000100:00100000:1.0:1787387711.247125:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787387711.247133:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709682560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387711.247291:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709682560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387711.247297:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787387711.248346:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709682560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387711.249046:0:8341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8341:1874211709682688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387711.249100:0:8341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.249137:0:8341:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.249187:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709682688 00000100:00100000:1.0:1787387711.249192:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709682688 00000100:00100000:1.0:1787387711.249227:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787387711.249234:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:8341:x1874211709682688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387711.249423:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:8341:x1874211709682688:12345-0@lo:502:llog_process_th.0 Request processed in 189us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387711.249431:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787387711.250018:0:8341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8341:1874211709682688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387711.250047:0:8341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387711.250056:0:8341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387711.250058:0:8341:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787387711.250064:0:8341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787387711.250086:0:8341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8341:1874211709682816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387711.250121:0:8341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.250152:0:8341:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387711.253060:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709682816 00000100:00100000:0.0:1787387711.253075:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709682816 00000100:00100000:0.0:1787387711.253148:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787387711.253157:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:8341:x1874211709682816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387711.253446:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:8341:x1874211709682816:12345-0@lo:502:llog_process_th.0 Request processed in 289us (3323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387711.253454:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787387711.254264:0:8341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8341:1874211709682816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387711.254302:0:8341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387711.254309:0:8341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387711.254312:0:8341:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787387711.254317:0:8341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787387711.257508:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787387711.257554:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787387711.257567:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387711.257580:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387711.257592:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787387711.257595:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d43434a99c0 from 1 10000000:01000000:0.0:1787387711.257597:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787387711.257657:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387711.257680:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387711.257692:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387711.257716:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709682944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787387711.257850:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387711.257895:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754180 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.258162:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709682944 00000100:00100000:1.0:1787387711.258171:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709682944 00000100:00100000:1.0:1787387711.258227:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787387711.258238:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709682944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387711.258252:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387711.258266:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c768a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7683 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.258291:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c768a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7683 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.258303:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c768a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7683 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387711.258314:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4600, rc 0) 00000100:00100000:1.0:1787387711.258363:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709682944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387711.258381:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787387711.258492:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709682944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387711.258506:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c768a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.258526:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c768a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387711.258585:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709683072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387711.258631:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387711.258650:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387711.258783:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709683072 00000100:00100000:1.0:1787387711.258788:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709683072 00000100:00100000:1.0:1787387711.258826:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787387711.258833:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709683072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387711.259077:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709683072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (444us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787387711.259084:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787387711.259276:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709683072:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787387711.259308:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787387711.259316:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7683 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c768a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387711.259324:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c768a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387711.837979:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387712.862893:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387713.887007:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387714.474034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387714.474082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387714.474126:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387714.474182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387714.474216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387714.474243:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690779648 00000100:00100000:1.0:1787387714.474252:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690779648 00000100:00100000:1.0:1787387714.474323:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:1.0:1787387714.474333:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690779648:12345-192.168.204.59@tcp:400: 00000100:00100000:1.0:1787387714.474422:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690779648:12345-192.168.204.59@tcp:400: Request processed in 90us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387714.474430:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:1.0:1787387714.474452:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690779776 00000100:00100000:1.0:1787387714.474455:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690779776 00000100:00100000:1.0:1787387714.474478:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690779904 00000100:00100000:1.0:1787387714.474480:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690779904 00000100:00100000:1.0:1787387714.474496:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:1.0:1787387714.474502:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690779776:12345-192.168.204.59@tcp:400: 00000100:00100000:1.0:1787387714.474559:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690779776:12345-192.168.204.59@tcp:400: Request processed in 57us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387714.474566:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:1.0:1787387714.474578:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:1.0:1787387714.474584:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690779904:12345-192.168.204.59@tcp:400: 00000100:00100000:3.0:1787387714.474891:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690779392 00000100:00100000:3.0:1787387714.474896:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690779392 00000100:00100000:3.0:1787387714.474920:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690779520 00000100:00100000:3.0:1787387714.474923:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690779520 00000100:00100000:3.0:1787387714.474937:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 166 00000100:00100000:3.0:1787387714.474950:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:5569:x1874211690779392:12345-192.168.204.59@tcp:101: 00010000:00010000:3.0:1787387714.474961:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387714.474978:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c7691 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5276f expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387714.475002:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c7691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5276f expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387714.475014:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c7691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5276f expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387714.475022:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152ec00, rc 0) 00000100:00100000:3.0:1787387714.475046:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5569:x1874211690779392:12345-192.168.204.59@tcp:101: Request processed in 96us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387714.475052:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 166 00000100:00100000:3.0:1787387714.475075:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 167 00000100:00100000:3.0:1787387714.475082:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:2350:x1874211690779520:12345-192.168.204.59@tcp:400: 00000100:00100000:3.0:1787387714.475102:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:2350:x1874211690779520:12345-192.168.204.59@tcp:400: Request processed in 21us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387714.475108:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 167 00000100:00080000:3.0:1787387714.475151:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787387714.475155:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387714.475157:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387714.475250:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690779904:12345-192.168.204.59@tcp:400: Request processed in 665us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387714.475258:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1787387714.482850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387714.483234:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690780032 00000100:00100000:3.0:1787387714.483246:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690780032 00000100:00100000:3.0:1787387714.483302:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:3.0:1787387714.483313:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:5569:x1874211690780032:12345-192.168.204.59@tcp:501: 00000100:00100000:3.0:1787387714.483654:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:5569:x1874211690780032:12345-192.168.204.59@tcp:501: Request processed in 342us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387714.483663:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:0.0:1787387714.487965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387714.488066:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690780160 00000100:00100000:2.0:1787387714.488076:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690780160 00000100:00100000:2.0:1787387714.488142:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 169 00000100:00100000:2.0:1787387714.488154:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:5569:x1874211690780160:12345-192.168.204.59@tcp:503: 00000100:00100000:2.0:1787387714.488381:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:5569:x1874211690780160:12345-192.168.204.59@tcp:503: Request processed in 230us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387714.488390:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 169 00000100:00100000:2.0:1787387714.503488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387714.505053:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690780288 00000100:00100000:0.0:1787387714.505068:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690780288 00000100:00100000:0.0:1787387714.505149:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 170 00000100:00100000:0.0:1787387714.505159:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:6054:x1874211690780288:12345-192.168.204.59@tcp:502: 00000100:00100000:0.0:1787387714.506568:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:6054:x1874211690780288:12345-192.168.204.59@tcp:502: Request processed in 1402us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387714.506580:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 170 00000100:00100000:0.0:1787387714.546472:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387714.546625:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690780416 00000100:00100000:3.0:1787387714.546635:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690780416 00000100:00100000:3.0:1787387714.546693:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 171 00000100:00100000:3.0:1787387714.546704:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:6054:x1874211690780416:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787387714.547037:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:6054:x1874211690780416:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 334us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387714.547045:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 171 00000100:00100000:1.0:1787387714.553573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387714.553775:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690780544 00000100:00100000:0.0:1787387714.553786:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690780544 00000100:00100000:0.0:1787387714.553841:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:0.0:1787387714.553851:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:5569:x1874211690780544:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387714.553867:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387714.553899:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c7698 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52776 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387714.553948:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c7698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52776 expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387714.553961:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c7698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52776 expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387714.553971:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340031e00, rc 0) 00000100:00100000:0.0:1787387714.554037:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5569:x1874211690780544:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 187us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387714.554045:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:1.0:1787387714.563351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387714.563623:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690780672 00000100:00100000:2.0:1787387714.563637:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690780672 00000100:00100000:2.0:1787387714.563713:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 173 00000100:00100000:2.0:1787387714.563724:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5569:x1874211690780672:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387714.564065:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5569:x1874211690780672:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 341us (727us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387714.564074:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 173 00010000:00010000:1.0:1787387714.910327:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387715.167134:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387715.167159:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709683200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387715.167227:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387715.167298:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709683200 00000100:00100000:0.0:1787387715.167306:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709683200 00000100:00100000:0.0:1787387715.167377:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387715.167386:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709683200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387715.167421:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387715.167470:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709683200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387715.167477:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787387715.167523:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4377c05500 x1874211709683200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387715.167555:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709683200:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787387715.167766:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387715.174368:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709683328:0@lo:400:kworker.0 00000100:00100000:3.0:1787387715.174417:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709683712:0@lo:400:kworker.0 00000100:00100000:0.0:1787387715.174447:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387715.174484:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709683456:0@lo:400:kworker.0 00000100:00100000:1.0:1787387715.175004:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709683584:0@lo:400:kworker.0 00000100:00100000:3.0:1787387715.181783:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387715.181790:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709683840:0@lo:400:kworker.0 00000100:00100000:3.0:1787387715.181841:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709683712 00000100:00100000:3.0:1787387715.181850:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709683712 00000100:00100000:0.0:1787387715.181861:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387715.181915:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387715.181921:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709683840 00000100:00100000:0.0:1787387715.181926:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709683840 00000100:00100000:3.0:1787387715.181927:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709683712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387715.181957:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787387715.181964:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709683840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387715.182019:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709683840:12345-0@lo:400:kworker.0 Request processed in 55us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387715.182026:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787387715.182176:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709683840:0@lo:400:kworker.0 00000100:00100000:2.0:1787387715.182237:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387715.182339:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709683456 00000100:00100000:0.0:1787387715.182344:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709683456 00000100:00100000:0.0:1787387715.182368:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787387715.182373:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709683456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387715.182403:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709683456:12345-0@lo:400:kworker.0 Request processed in 29us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387715.182409:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787387715.182455:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787387715.182459:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387715.182467:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709683328 00000100:00100000:0.0:1787387715.182471:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709683328 00000100:00100000:0.0:1787387715.182492:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787387715.182497:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709683328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387715.182537:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709683328:12345-0@lo:400:kworker.0 Request processed in 29us (8080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387715.182542:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787387715.182572:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709683328:0@lo:400:kworker.0 00000100:00100000:1.0:1787387715.182763:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387715.182803:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709683584 00000100:00100000:3.0:1787387715.182806:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709683712:12345-0@lo:400:kworker.0 Request processed in 884us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387715.182807:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709683584 00000100:00100000:3.0:1787387715.182814:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787387715.182833:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787387715.182840:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709683584:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787387715.182842:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a5d9c00 x1874211709683712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387715.182854:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709683712:0@lo:400:kworker.0 00000100:00100000:1.0:1787387715.182872:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709683584:12345-0@lo:400:kworker.0 Request processed in 33us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387715.182878:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787387715.182891:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387715.182911:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709683584:0@lo:400:kworker.0 00000100:00100000:2.0:1787387715.185498:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709683456:0@lo:400:kworker.0 00010000:00010000:0.0:1787387715.933989:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787387715.985639:0:8379:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffdac420410 00000020:00000080:3.0:1787387715.985654:0:8379:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787387715.985659:0:8379:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787387715.985675:0:8379:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdac4226a0 20000000:00000080:3.0:1787387715.985682:0:8379:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d4372019c00 uarg=0000000000000000 20000000:01000000:3.0:1787387715.985720:0:8379:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787387715.985726:0:8379:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787387715.985731:0:8379:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787387715.990244:0:8380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787387715.990485:0:8379:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787387715.999865:0:8379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787387715.999924:0:8379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787387715.999995:0:8379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787387716.000014:0:8379:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787387716.000034:0:8379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.000053:0:8379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d43413fd000/0x93d41aeaa23c7414 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c740d expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.000061:0:8379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d43413fde00/0x93d41aeaa23c7476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c746f expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.000067:0:8379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c7541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c753a expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.000076:0:8379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4242f91000/0x93d41aeaa23c75fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5273e expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.000083:0:8379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.000121:0:8379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4242f91000/0x93d41aeaa23c75fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5273e expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.000136:0:8379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4242f91000/0x93d41aeaa23c75fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5273e expref: 9 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387716.000152:0:8379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8379:1874211709683968:192.168.204.59@tcp:104: 00010000:00010000:1.0:1787387716.000260:0:8379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c7541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c753a expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.000269:0:8379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c7541 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c753a expref: 18 pid: 5801 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387716.000286:0:8379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8379:1874211709684096:0@lo:104: 00000100:00100000:1.0:1787387716.000333:0:8379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387716.000640:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709684096 00000100:00100000:3.0:1787387716.000648:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709684096 00000100:00100000:3.0:1787387716.000698:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787387716.000707:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:8379:x1874211709684096:12345-0@lo:104: 00010000:00010000:3.0:1787387716.000720:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387716.000795:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387716.000802:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:8379:x1874211709684096:12345-0@lo:104: Request processed in 96us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387716.000808:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787387716.001026:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387716.001032:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.001040:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030c00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387716.001044:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.001053:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387716.001059:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387716.001065:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787387716.001102:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.001109:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387716.001134:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.001140:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4340030c00/0x93d41aeaa23c753a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7541 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.001154:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387716.001156:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387716.001165:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387716.001182:0:8379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d43413fde00/0x93d41aeaa23c7476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c746f expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.001191:0:8379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d43413fde00/0x93d41aeaa23c7476 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c746f expref: 18 pid: 5800 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387716.001200:0:8379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8379:1874211709684352:0@lo:104: 00000100:00100000:1.0:1787387716.001229:0:8379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387716.001257:0:8379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d43413fd000/0x93d41aeaa23c7414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c740d expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387716.001265:0:8379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d43413fd000/0x93d41aeaa23c7414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c740d expref: 18 pid: 5801 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387716.001274:0:8379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8379:1874211709684480:0@lo:104: 00000100:00100000:1.0:1787387716.001295:0:8379:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253d80 going to sleep for 10 seconds 00000100:00100000:1.0:1787387716.001315:0:8379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8379:1874211709684096:0@lo:104: 00000100:00100000:0.0:1787387716.001840:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387716.001854:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709684224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387716.001885:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387716.001914:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709684224 00000100:00100000:0.0:1787387716.001919:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709684224 00010000:00010000:0.0:1787387716.001942:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c7541 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c753a expref: 19 pid: 5801 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387716.001966:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787387716.001974:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709684224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387716.001984:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387716.001989:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c7541 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c753a expref: 19 pid: 5801 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.001999:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c7541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c753a expref: 19 pid: 5801 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.002013:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c7541 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c753a expref: 19 pid: 5801 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.002026:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387716.002054:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:3313:x1874211709684224:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387716.002060:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787387716.002091:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709684224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387716.002350:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787387716.002382:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387716.002415:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709684352 00000100:00100000:3.0:1787387716.002421:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709684352 00000100:00100000:3.0:1787387716.002449:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709684480 00000100:00100000:3.0:1787387716.002453:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709684480 00000100:00100000:3.0:1787387716.002465:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387716.002472:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43745e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:8379:x1874211709684352:12345-0@lo:104: 00010000:00010000:3.0:1787387716.002482:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387716.002533:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387716.002537:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43745e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:8379:x1874211709684352:12345-0@lo:104: Request processed in 67us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387716.002554:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387716.002586:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387716.002592:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:8379:x1874211709684480:12345-0@lo:104: 00010000:00010000:3.0:1787387716.002601:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c740d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387716.002631:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787387716.002636:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:8379:x1874211709684480:12345-0@lo:104: Request processed in 45us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387716.002642:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787387716.002861:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387716.002873:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.002880:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd600 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387716.002885:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.002892:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387716.002898:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387716.002903:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787387716.002930:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.002936:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387716.002956:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.002964:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d43413fd600/0x93d41aeaa23c746f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7476 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.002976:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387716.002979:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c740d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.002985:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387716.002987:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c740d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.003004:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c740d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387716.003010:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c740d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387716.003015:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787387716.003029:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c740d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.003035:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387716.003041:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c740d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.003046:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c740d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c7414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.003058:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387716.003060:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387716.003061:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387716.003074:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709684608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387716.003102:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387716.003119:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387716.003125:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709684736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387716.003142:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387716.003168:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709684608 00000100:00100000:0.0:1787387716.003173:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709684608 00010000:00010000:0.0:1787387716.003189:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d43413fde00/0x93d41aeaa23c7476 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c746f expref: 18 pid: 5800 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387716.003221:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709684736 00000100:00100000:0.0:1787387716.003224:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709684736 00010000:00010000:0.0:1787387716.003237:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d43413fd000/0x93d41aeaa23c7414 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c740d expref: 19 pid: 5801 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387716.003252:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787387716.003259:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709684608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387716.003268:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387716.003272:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d43413fde00/0x93d41aeaa23c7476 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c746f expref: 19 pid: 5800 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.003282:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d43413fde00/0x93d41aeaa23c7476 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c746f expref: 19 pid: 5800 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.003293:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387716.003320:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709684608:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387716.003326:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787387716.003339:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787387716.003344:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:3311:x1874211709684736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387716.003351:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387716.003355:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d43413fd000/0x93d41aeaa23c7414 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c740d expref: 18 pid: 5801 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.003362:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d43413fd000/0x93d41aeaa23c7414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c740d expref: 18 pid: 5801 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.003389:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387716.003557:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:3311:x1874211709684736:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387716.003564:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787387716.003604:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709684736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387716.003611:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709684608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787387716.003934:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387716.003960:0:8379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43413fde00/0x93d41aeaa23c7476 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c746f expref: 17 pid: 5800 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387716.003973:0:8379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8379:1874211709684352:0@lo:104: 00010000:00010000:1.0:1787387716.003983:0:8379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43413fd000/0x93d41aeaa23c7414 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c740d expref: 16 pid: 5801 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387716.003989:0:8379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8379:1874211709684480:0@lo:104: 00000100:00100000:1.0:1787387716.015048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387716.015143:0:8379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8379:1874211709683968:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387716.015181:0:8379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387716.015257:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690780800 00000100:00100000:0.0:1787387716.015264:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690780800 00010000:00010000:0.0:1787387716.015296:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4242f91000/0x93d41aeaa23c75fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5273e expref: 10 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387716.015331:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:0.0:1787387716.015340:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690780800:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387716.015355:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387716.015360:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4242f91000/0x93d41aeaa23c75fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5273e expref: 10 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.015388:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4242f91000/0x93d41aeaa23c75fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5273e expref: 10 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.015406:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f91000/0x93d41aeaa23c75fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5273e expref: 10 pid: 5802 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.015431:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.015441:0:8324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.015457:0:8324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.015476:0:8324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.015484:0:8324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.015491:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.015497:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5a00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387716.015501:0:8324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.015518:0:8324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387716.023659:0:8379:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387716.023677:0:8379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.025406:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.025575:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad5a00/0x93d41aeaa23c769f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387716.025596:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387716.025890:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:2351:x1874211690780800:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 10546us (10846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387716.025901:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:0.0:1787387716.207537:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709684864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387716.207616:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387716.207689:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709684864 00000100:00100000:0.0:1787387716.207703:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709684864 00000100:00100000:0.0:1787387716.207765:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387716.207775:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709684864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787387716.207813:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387716.207860:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709684864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387716.207867:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787387716.207908:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43747ca300 x1874211709684864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387716.207940:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709684864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387716.960796:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387717.674097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387717.674310:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690780928 00000100:00100000:3.0:1787387717.674320:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690780928 00000100:00100000:3.0:1787387717.674373:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 175 00000100:00100000:3.0:1787387717.674389:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+9:5569:x1874211690780928:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387717.674406:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387717.674424:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c76a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5277d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.674448:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c76a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5277d expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.674459:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c76a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5277d expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.674467:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e400, rc 0) 00000100:00100000:3.0:1787387717.674587:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5569:x1874211690780928:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 198us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387717.674604:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 175 00000100:00100000:0.0:1787387717.693928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387717.697255:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690781056 00000100:00100000:3.0:1787387717.697267:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690781056 00000100:00100000:3.0:1787387717.697344:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 176 00000100:00100000:3.0:1787387717.697354:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5569:x1874211690781056:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.697648:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5569:x1874211690781056:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 294us (3737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387717.697656:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 176 00000100:00100000:3.0:1787387717.708026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387717.708569:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690781184 00000100:00100000:0.0:1787387717.708582:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690781184 00000100:00100000:0.0:1787387717.708641:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00100000:0.0:1787387717.708652:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5569:x1874211690781184:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387717.708911:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:5569:x1874211690781184:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 259us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387717.708919:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00100000:3.0:1787387717.713833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387717.714211:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690781312 00000100:00100000:0.0:1787387717.714222:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690781312 00000100:00100000:0.0:1787387717.714279:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 178 00000100:00100000:0.0:1787387717.714290:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:6112:x1874211690781312:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787387717.714576:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:6112:x1874211690781312:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 286us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387717.714595:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 178 00000100:00100000:0.0:1787387717.721503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387717.722046:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690781440 00000100:00100000:3.0:1787387717.722056:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690781440 00000100:00100000:3.0:1787387717.722152:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 179 00000100:00100000:3.0:1787387717.722162:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:6112:x1874211690781440:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787387717.722428:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:6112:x1874211690781440:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 266us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387717.722435:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 179 10000000:01000000:3.0:1787387717.917861:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787387717.917870:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4377c90800 from 4 10000000:01000000:3.0:1787387717.917875:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787387717.917931:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.917946:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.917960:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387717.917998:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709684992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.918073:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387717.918127:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787387717.918465:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709684992 00000100:00100000:0.0:1787387717.918483:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709684992 00000100:00100000:0.0:1787387717.918537:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787387717.918548:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709684992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387717.918562:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387717.918576:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c76b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c76ad expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387717.918600:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c76b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c76ad expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387717.918611:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c76b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c76ad expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387717.918622:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340030a00, rc 0) 00000100:00100000:0.0:1787387717.918664:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709684992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387717.918670:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787387717.919549:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709684992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387717.919584:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.919596:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387717.919671:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709685120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.919722:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387717.919783:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787387717.919856:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709685120 00000100:00100000:0.0:1787387717.919863:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709685120 00000100:00100000:0.0:1787387717.919905:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787387717.919914:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709685120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387717.920224:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709685120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387717.920230:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787387717.920324:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709685120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.920359:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709685248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.920480:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387717.920501:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787387717.920542:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709685248 00000100:00100000:0.0:1787387717.920547:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709685248 00000100:00100000:0.0:1787387717.920829:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787387717.920839:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709685248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387717.920988:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709685248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387717.920994:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787387717.921365:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709685248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387717.923501:0:8444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8444:1874211709685376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387717.924058:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387717.924112:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709685376 00000100:00100000:0.0:1787387717.924120:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709685376 00000100:00100000:0.0:1787387717.924167:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787387717.924176:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:8444:x1874211709685376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387717.924250:0:8444:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43517543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387717.924408:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:8444:x1874211709685376:12345-0@lo:502:llog_process_th.0 Request processed in 233us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387717.924416:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787387717.924498:0:8444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8444:1874211709685376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387717.924531:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387717.924624:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387717.924627:0:8444:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787387717.924634:0:8444:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4377c90800 00000020:00000080:2.0:1787387717.924637:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787387717.924725:0:8444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8444:1874211709685504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387717.924784:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387717.924798:0:8444:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43517543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387717.925801:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709685504 00000100:00100000:2.0:1787387717.925811:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709685504 00000100:00100000:2.0:1787387717.925851:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787387717.925860:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:8444:x1874211709685504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387717.926077:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:8444:x1874211709685504:12345-0@lo:502:llog_process_th.0 Request processed in 217us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387717.926085:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787387717.926156:0:8444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8444:1874211709685504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387717.926188:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387717.926196:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387717.926198:0:8444:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787387717.926203:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787387717.926262:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787387717.926281:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387717.926291:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387717.926303:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387717.926314:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787387717.926316:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4379110800 from 4 10000000:01000000:2.0:1787387717.926325:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387717.926359:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387717.926368:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387717.926377:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387717.926397:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709685632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387717.926431:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387717.926458:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a2a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387717.926469:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709685632 00000100:00100000:2.0:1787387717.926485:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709685632 00000100:00100000:2.0:1787387717.926504:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787387717.926510:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709685632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387717.926520:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387717.926534:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c76c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c76bb expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387717.926559:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c76c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c76bb expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387717.926569:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c76c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c76bb expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387717.926578:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91e00, rc 0) 00000100:00100000:2.0:1787387717.926608:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709685632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387717.926622:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787387717.926652:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709685632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387717.926664:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387717.926674:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387717.926720:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709685760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387717.926765:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387717.926780:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754780 going to sleep for 11 seconds 00000100:00100000:2.0:1787387717.926791:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709685760 00000100:00100000:2.0:1787387717.926794:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709685760 00000100:00100000:2.0:1787387717.926814:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787387717.926820:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709685760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387717.927043:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709685760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387717.927050:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787387717.927078:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709685760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387717.927102:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709685888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387717.927134:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387717.927145:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754780 going to sleep for 11 seconds 00000100:00100000:2.0:1787387717.927156:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709685888 00000100:00100000:2.0:1787387717.927159:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709685888 00000100:00100000:2.0:1787387717.927178:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787387717.927190:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709685888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387717.927315:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709685888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387717.927322:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787387717.927361:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709685888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.929300:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8446:1874211709686016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387717.929366:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387717.929396:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709686016 00000100:00100000:3.0:1787387717.929401:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709686016 00000100:00100000:3.0:1787387717.929434:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787387717.929440:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:8446:x1874211709686016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387717.929646:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:8446:x1874211709686016:12345-0@lo:502:llog_process_th.0 Request processed in 205us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387717.929654:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787387717.929706:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387717.929728:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8446:1874211709686016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387717.929778:0:8446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387717.929787:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387717.929790:0:8446:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787387717.929795:0:8446:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4379110800 00000020:00000080:3.0:1787387717.929797:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787387717.930239:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8446:1874211709686144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387717.930280:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387717.930310:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387717.930693:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709686144 00000100:00100000:2.0:1787387717.930700:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709686144 00000100:00100000:2.0:1787387717.930768:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787387717.930778:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434657a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:8446:x1874211709686144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387717.930988:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434657a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:8446:x1874211709686144:12345-0@lo:502:llog_process_th.0 Request processed in 211us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387717.930995:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787387717.935251:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8446:1874211709686144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387717.935487:0:8446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387717.935496:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387717.935499:0:8446:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787387717.935503:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787387717.935654:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787387717.935675:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787387717.935686:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.935697:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387717.935708:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787387717.935711:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4350ce4000 from 4 10000000:01000000:3.0:1787387717.935717:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787387717.935768:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.935778:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.935787:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387717.935807:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709686272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.935867:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387717.935900:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387717.935917:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709686272 00000100:00100000:3.0:1787387717.935922:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709686272 00000100:00100000:3.0:1787387717.935967:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787387717.935976:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709686272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387717.935989:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387717.936001:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152fc00/0x93d41aeaa23c76d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c76c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.936025:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152fc00/0x93d41aeaa23c76d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c76c9 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.936035:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152fc00/0x93d41aeaa23c76d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c76c9 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.936044:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152fc00, rc 0) 00000100:00100000:3.0:1787387717.936080:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709686272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387717.936095:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787387717.937275:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709686272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387717.937309:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387717.937319:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387717.937381:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709686400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.937423:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387717.937452:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387717.937468:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709686400 00000100:00100000:3.0:1787387717.937484:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709686400 00000100:00100000:3.0:1787387717.937520:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787387717.937528:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434657b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709686400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.938023:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434657b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709686400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 494us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387717.938031:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787387717.938069:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709686400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.938104:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709686528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.939697:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387717.939734:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387717.947002:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709686528 00000100:00100000:3.0:1787387717.947017:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709686528 00000100:00100000:3.0:1787387717.947070:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787387717.947088:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709686528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387717.947360:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709686528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (7663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387717.947369:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787387717.947448:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709686528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387717.955556:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8451:1874211709686656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387717.955666:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387717.955705:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709686656 00000100:00100000:2.0:1787387717.955712:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709686656 00000100:00100000:2.0:1787387717.955797:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787387717.955806:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:8451:x1874211709686656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387717.956015:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:8451:x1874211709686656:12345-0@lo:502:llog_process_th.0 Request processed in 208us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387717.956023:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787387717.956072:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347c15b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387717.956095:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8451:1874211709686656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387717.956124:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387717.956140:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387717.956142:0:8451:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787387717.956149:0:8451:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4350ce4000 00000020:00000080:2.0:1787387717.956152:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787387717.956487:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8451:1874211709686784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387717.956526:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387717.956548:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d42419c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387717.956802:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709686784 00000100:00100000:3.0:1787387717.956807:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709686784 00000100:00100000:3.0:1787387717.956983:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787387717.956992:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:8451:x1874211709686784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387717.957141:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:8451:x1874211709686784:12345-0@lo:502:llog_process_th.0 Request processed in 150us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387717.957148:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787387717.959237:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:8451:1874211709686784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387717.959279:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387717.960800:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387717.960804:0:8451:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787387717.960811:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787387717.960881:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787387717.960903:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387717.960915:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387717.960929:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387717.983506:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387719.005897:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387719.595688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387719.595808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387719.595844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387719.595871:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387719.595905:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690781568 00000100:00100000:1.0:1787387719.595915:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690781568 00000100:00100000:1.0:1787387719.595967:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 195 00000100:00100000:1.0:1787387719.595977:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2350:x1874211690781568:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387719.596051:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2350:x1874211690781568:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387719.596059:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 195 00000100:00100000:1.0:1787387719.596107:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690781952 00000100:00100000:1.0:1787387719.596111:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690781952 00000100:00100000:1.0:1787387719.596148:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690781824 00000100:00100000:1.0:1787387719.596151:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690781824 00000100:00100000:1.0:1787387719.596167:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1787387719.596174:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690781952:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387719.596203:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690781952:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 30us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387719.596210:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1787387719.596222:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1787387719.596228:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690781824:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387719.596256:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690781824:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387719.596262:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00080000:1.0:1787387719.596372:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387719.596377:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387719.596893:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690781696 00000100:00100000:2.0:1787387719.596900:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690781696 00000100:00100000:2.0:1787387719.596946:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:2.0:1787387719.596954:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690781696:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387719.596998:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690781696:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 46us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387719.597006:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00080000:1.0:1787387719.599498:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787387720.029948:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387720.287539:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709686912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387720.287619:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387720.287713:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709686912 00000100:00100000:0.0:1787387720.287723:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709686912 00000100:00100000:0.0:1787387720.287803:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787387720.287813:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709686912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387720.287849:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387720.287902:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709686912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387720.287910:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787387720.287936:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787387720.287972:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43747ca300 x1874211709686912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387720.288000:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709686912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387720.290699:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709687296:0@lo:400:kworker.0 00000100:00100000:1.0:1787387720.290802:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387720.290847:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387720.290852:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709687424:0@lo:400:kworker.0 00000100:00100000:1.0:1787387720.290877:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387720.290907:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709687296 00000100:00100000:1.0:1787387720.290914:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709687296 00000100:00100000:1.0:1787387720.290965:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787387720.290974:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709687296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387720.291027:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709687296:12345-0@lo:400:kworker.0 Request processed in 54us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387720.291033:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787387720.291053:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709687424 00000100:00100000:1.0:1787387720.291056:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709687424 00000100:00100000:1.0:1787387720.291082:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787387720.291087:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709687424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387720.291117:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709687424:12345-0@lo:400:kworker.0 Request processed in 30us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387720.291123:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787387720.291161:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43720a8000 x1874211709687424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387720.291452:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709687040:0@lo:400:kworker.0 00000100:00100000:2.0:1787387720.291503:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387720.291531:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709687552:0@lo:400:kworker.0 00000100:00100000:2.0:1787387720.291555:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387720.291575:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387720.291580:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709687168:0@lo:400:kworker.0 00000100:00100000:2.0:1787387720.291602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387720.291628:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709687040 00000100:00100000:2.0:1787387720.291632:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709687040 00000100:00100000:2.0:1787387720.291662:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787387720.291668:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709687040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387720.291701:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709687040:12345-0@lo:400:kworker.0 Request processed in 33us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387720.291707:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787387720.291735:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709687552 00000100:00100000:2.0:1787387720.291738:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709687552 00000100:00100000:2.0:1787387720.291778:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709687168 00000100:00100000:2.0:1787387720.291782:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709687168 00000100:00100000:2.0:1787387720.291797:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787387720.291803:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709687552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387720.291832:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709687552:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387720.291837:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787387720.291848:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787387720.291855:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709687168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387720.291880:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709687168:12345-0@lo:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387720.291895:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787387720.291938:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709687168:0@lo:400:kworker.0 00000100:00100000:2.0:1787387720.291948:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709687040:0@lo:400:kworker.0 00000100:00100000:2.0:1787387720.291958:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709687552:0@lo:400:kworker.0 00000100:00100000:1.0:1787387720.292694:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709687424:0@lo:400:kworker.0 00000100:00100000:1.0:1787387720.292715:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709687296:0@lo:400:kworker.0 00000100:00080000:1.0:1787387720.292866:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387720.292880:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787387721.053915:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387721.316492:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387721.316517:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709687680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387721.316590:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387721.316660:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709687680 00000100:00100000:2.0:1787387721.316668:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709687680 00000100:00100000:2.0:1787387721.316716:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787387721.316726:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709687680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387721.316794:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387721.316839:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709687680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387721.316846:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787387721.316887:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4377c04e00 x1874211709687680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387721.316905:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709687680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787387722.077982:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387723.113866:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787387723.365143:0:8678:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787387724.125970:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387724.723596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387724.723643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387724.723709:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690782208 00000100:00100000:2.0:1787387724.723720:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690782208 00000100:00100000:2.0:1787387724.723813:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1787387724.723823:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2353:x1874211690782208:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387724.723906:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2353:x1874211690782208:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 84us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387724.723926:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00080000:0.0:1787387724.724370:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387724.727599:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690782080 00000100:00100000:3.0:1787387724.727616:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690782080 00000100:00100000:3.0:1787387724.727776:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 197 00000100:00100000:3.0:1787387724.727788:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2353:x1874211690782080:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387724.727874:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2353:x1874211690782080:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 88us (4285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387724.727883:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 197 00000100:00100000:0.0:1787387724.728218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387724.728327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387724.728400:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690782336 00000100:00100000:1.0:1787387724.728405:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690782336 00000100:00100000:1.0:1787387724.728444:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690782464 00000100:00100000:1.0:1787387724.728446:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690782464 00000100:00100000:1.0:1787387724.728460:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1787387724.728466:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2349:x1874211690782336:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:1.0:1787387724.728491:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c760c 00000100:00080000:1.0:1787387724.728499:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d42411a4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787387724.728540:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787387724.729025:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+2:2349:x1874211690782336:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 556us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387724.729034:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1787387724.729051:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:1.0:1787387724.729057:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2349:x1874211690782464:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:1.0:1787387724.729073:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7613 00000100:00080000:1.0:1787387724.729080:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d437a71f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787387724.729100:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787387724.729321:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+2:2349:x1874211690782464:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 263us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387724.729328:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00010000:00010000:1.0:1787387724.729469:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787387724.730086:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787387724.730094:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787387724.730122:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387725.162969:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387725.408111:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387725.408133:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709687808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387725.408220:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387725.408371:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709687808 00000100:00100000:2.0:1787387725.408379:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709687808 00000100:00100000:2.0:1787387725.408444:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787387725.408455:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709687808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787387725.408490:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387725.408536:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709687808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387725.408543:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787387725.408624:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4350d1ca80 x1874211709687808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387725.408643:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709687808:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787387725.409359:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387725.411111:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709688064:0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411164:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387725.411208:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387725.411214:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709688192:0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411233:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387725.411263:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709688064 00000100:00100000:2.0:1787387725.411269:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709688064 00000100:00100000:2.0:1787387725.411305:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709688192 00000100:00100000:2.0:1787387725.411307:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709688192 00000100:00100000:2.0:1787387725.411342:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787387725.411350:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709688064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411395:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709688064:12345-0@lo:400:kworker.0 Request processed in 45us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387725.411411:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787387725.411427:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787387725.411433:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709688192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411462:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709688192:12345-0@lo:400:kworker.0 Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387725.411467:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787387725.411494:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709688320:0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411519:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387725.411538:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787387725.411543:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709687936:0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411567:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387725.411589:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709688448:0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411608:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387725.411631:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709688320 00000100:00100000:2.0:1787387725.411635:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709688320 00000100:00100000:2.0:1787387725.411663:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787387725.411669:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709688320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411702:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709688320:12345-0@lo:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387725.411708:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787387725.411723:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709687936 00000100:00100000:2.0:1787387725.411727:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709687936 00000100:00100000:2.0:1787387725.411765:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787387725.411771:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709687936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411795:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709687936:12345-0@lo:400:kworker.0 Request processed in 24us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387725.411805:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787387725.411851:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709687936:0@lo:400:kworker.0 00010000:00080000:2.0:1787387725.411863:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4377c04a80 x1874211709688320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387725.411873:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709688320:0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411899:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709688192:0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411907:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709688064:0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.411921:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709688448 00000100:00100000:2.0:1787387725.411923:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709688448 00000100:00100000:2.0:1787387725.412076:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787387725.412083:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709688448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387725.412119:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709688448:12345-0@lo:400:kworker.0 Request processed in 37us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387725.412125:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787387725.412151:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709688448:0@lo:400:kworker.0 00000100:00080000:0.0:1787387725.412612:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787387725.412618:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1787387725.973854:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000020:00000080:1.0:1787387725.973863:0:6629:0:(genops.c:906:class_export_put()) final put ffff8d42411a7000/d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000020:00000080:2.0:1787387725.973941:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d42411a7000/d7138a1c-1444-4499-9235-7f89dd5ceb0b for lustre-OST0000 00000020:00000080:2.0:1787387725.973992:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d42411a4000 for lustre-OST0000 00010000:00010000:0.0:1787387726.176308:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387726.435143:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387726.435194:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709688576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387726.435268:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387726.435408:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709688576 00000100:00100000:2.0:1787387726.435416:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709688576 00000100:00100000:2.0:1787387726.435468:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787387726.435476:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709688576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387726.435507:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387726.435552:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709688576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387726.435565:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787387726.435721:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4377c05f80 x1874211709688576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387726.435771:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709688576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787387727.207008:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787387728.039311:0:7514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000020:00000080:3.0:1787387728.039320:0:7514:0:(genops.c:906:class_export_put()) final put ffff8d437a71a000/d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000020:00000080:1.0:1787387728.040387:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d437a71a000/d7138a1c-1444-4499-9235-7f89dd5ceb0b for lustre-OST0001 00000020:00000080:1.0:1787387728.040448:0:474:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d437a71f800 for lustre-OST0001 00010000:00010000:0.0:1787387728.222030:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387729.249782:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387729.839150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387729.839361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387729.839397:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690782720 00000100:00100000:0.0:1787387729.839407:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690782720 00000100:00100000:0.0:1787387729.839468:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:0.0:1787387729.839477:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690782720:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387729.839549:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690782720:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 73us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387729.839557:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00080000:0.0:1787387729.839584:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387729.839650:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690782592 00000100:00100000:2.0:1787387729.839655:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690782592 00000100:00100000:2.0:1787387729.839683:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 199 00000100:00100000:2.0:1787387729.839690:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690782592:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387729.839736:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690782592:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 46us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387729.839759:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 199 00000001:02000400:1.0:1787387730.203479:0:8925:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing yml_node 00010000:00010000:0.0:1787387730.271981:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387730.533096:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387730.533118:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709688704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387730.533195:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387730.533262:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709688704 00000100:00100000:0.0:1787387730.533269:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709688704 00000100:00100000:0.0:1787387730.533323:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787387730.533332:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709688704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387730.533369:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387730.533426:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709688704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387730.533433:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787387730.533453:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787387730.533720:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4350d1f480 x1874211709688704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387730.533765:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709688704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387730.536260:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709689216:0@lo:400:kworker.0 00000100:00100000:2.0:1787387730.536338:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387730.536387:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387730.536394:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709689088:0@lo:400:kworker.0 00000100:00100000:2.0:1787387730.536431:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387730.536477:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709688832:0@lo:400:kworker.0 00000100:00100000:2.0:1787387730.536508:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387730.536535:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709689344:0@lo:400:kworker.0 00000100:00100000:2.0:1787387730.536557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387730.536573:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387730.536579:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709688960:0@lo:400:kworker.0 00000100:00100000:2.0:1787387730.536597:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387730.536671:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709689088 00000100:00100000:2.0:1787387730.536679:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709689088 00000100:00100000:2.0:1787387730.536725:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709689344 00000100:00100000:2.0:1787387730.536728:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709689344 00000100:00100000:2.0:1787387730.536766:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709688960 00000100:00100000:2.0:1787387730.536769:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709688960 00000100:00100000:2.0:1787387730.536801:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787387730.536808:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709689088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387730.536863:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709689088:12345-0@lo:400:kworker.0 Request processed in 53us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387730.537106:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709689216 00000100:00100000:3.0:1787387730.537110:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709689216 00000100:00100000:3.0:1787387730.537157:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787387730.537173:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709689216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387730.537207:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709689216:12345-0@lo:400:kworker.0 Request processed in 38us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387730.537213:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787387730.537523:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787387730.537539:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787387730.537547:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709689344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387730.537594:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709689344:12345-0@lo:400:kworker.0 Request processed in 48us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387730.537600:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787387730.537611:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787387730.537617:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709688960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387730.537641:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709688960:12345-0@lo:400:kworker.0 Request processed in 25us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387730.537647:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787387730.537664:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709688832 00000100:00100000:2.0:1787387730.537667:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709688832 00000100:00100000:2.0:1787387730.537686:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787387730.537691:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709688832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387730.537714:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709688832:12345-0@lo:400:kworker.0 Request processed in 22us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387730.537719:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787387730.537788:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709689088:0@lo:400:kworker.0 00010000:00080000:2.0:1787387730.537801:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a5da680 x1874211709689216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387730.537824:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709689216:0@lo:400:kworker.0 00000100:00100000:3.0:1787387730.538235:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709688960:0@lo:400:kworker.0 00000100:00100000:3.0:1787387730.538246:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709688832:0@lo:400:kworker.0 00000100:00100000:3.0:1787387730.538255:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709689344:0@lo:400:kworker.0 00000100:00080000:0.0:1787387730.538573:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787387730.538579:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787387731.295282:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387731.553914:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387731.553939:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4377c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709689472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387731.554008:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387731.554122:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709689472 00000100:00100000:0.0:1787387731.554130:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709689472 00000100:00100000:0.0:1787387731.554186:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787387731.554213:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709689472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787387731.554253:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387731.554303:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709689472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387731.554321:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787387731.554358:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4377c07b80 x1874211709689472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387731.554374:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4377c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709689472:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387732.317998:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387733.343029:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387734.365934:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387734.956694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387734.957112:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690782848 00000100:00100000:2.0:1787387734.957123:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690782848 00000100:00100000:2.0:1787387734.957195:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 201 00000100:00100000:2.0:1787387734.957206:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690782848:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387734.957301:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690782848:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 97us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387734.957309:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 201 00000100:00100000:0.0:1787387734.958041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387734.958122:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690782976 00000100:00100000:2.0:1787387734.958129:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690782976 00000100:00100000:2.0:1787387734.958241:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:2.0:1787387734.958250:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690782976:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387734.958310:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690782976:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 61us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387734.958317:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00080000:0.0:1787387734.963761:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787387735.389906:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387735.647590:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387735.647614:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709689600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387735.647681:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387735.647815:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709689600 00000100:00100000:0.0:1787387735.647824:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709689600 00000100:00100000:0.0:1787387735.647884:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787387735.647895:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709689600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387735.647932:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387735.647988:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709689600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387735.647995:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787387735.648036:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4350d1dc00 x1874211709689600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387735.648054:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709689600:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787387735.648182:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387735.651154:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709689856:0@lo:400:kworker.0 00000100:00100000:0.0:1787387735.651217:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387735.651252:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387735.651266:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709689984:0@lo:400:kworker.0 00000100:00100000:0.0:1787387735.651289:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387735.651321:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709689856 00000100:00100000:0.0:1787387735.651328:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709689856 00000100:00100000:0.0:1787387735.651366:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709689984 00000100:00100000:0.0:1787387735.651370:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709689984 00000100:00100000:0.0:1787387735.651397:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787387735.651404:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709689856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387735.651454:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709689856:12345-0@lo:400:kworker.0 Request processed in 49us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387735.651461:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787387735.651478:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787387735.651483:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709689984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387735.651506:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709689984:12345-0@lo:400:kworker.0 Request processed in 24us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387735.651511:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787387735.651531:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387735.651560:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709689984:0@lo:400:kworker.0 00000100:00100000:0.0:1787387735.651570:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709689856:0@lo:400:kworker.0 00000100:00100000:2.0:1787387735.651803:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709689728:0@lo:400:kworker.0 00000100:00100000:2.0:1787387735.651839:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387735.651880:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709690240:0@lo:400:kworker.0 00000100:00100000:2.0:1787387735.651903:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387735.651919:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387735.651924:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709690112:0@lo:400:kworker.0 00000100:00100000:2.0:1787387735.651945:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387735.651987:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709689728 00000100:00100000:2.0:1787387735.651991:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709689728 00000100:00100000:2.0:1787387735.652017:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787387735.652023:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709689728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387735.652055:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709689728:12345-0@lo:400:kworker.0 Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387735.652061:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787387735.652100:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709690112 00000100:00100000:2.0:1787387735.652104:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709690112 00000100:00100000:2.0:1787387735.652147:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787387735.652154:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709690112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387735.652187:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709690112:12345-0@lo:400:kworker.0 Request processed in 34us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387735.652193:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787387735.652226:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43720a8a80 x1874211709690112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387735.652237:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709690112:0@lo:400:kworker.0 00000100:00100000:2.0:1787387735.652246:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709689728:0@lo:400:kworker.0 00000100:00080000:0.0:1787387735.652806:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387735.652818:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709690240 00000100:00100000:0.0:1787387735.652822:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709690240 00000100:00100000:0.0:1787387735.652860:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787387735.652868:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709690240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387735.652918:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709690240:12345-0@lo:400:kworker.0 Request processed in 50us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387735.652936:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787387735.655922:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709690240:0@lo:400:kworker.0 00000100:00080000:2.0:1787387735.656225:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787387736.415254:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787387736.522918:0:9117:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.111 00000100:00100000:2.0:1787387736.670732:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387736.672488:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d434645ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709690368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387736.672684:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387736.672835:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709690368 00000100:00100000:0.0:1787387736.672843:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709690368 00000100:00100000:0.0:1787387736.672894:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387736.672904:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709690368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787387736.672942:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387736.673201:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709690368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387736.673210:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787387736.673444:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d434645ad80 x1874211709690368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387736.673464:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d434645ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709690368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387737.439642:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387738.461906:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387739.487023:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787387739.896563:0:9215:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.111 00000100:00100000:1.0:1787387740.080294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387740.085923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387740.088447:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690783232 00000100:00100000:3.0:1787387740.088462:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690783232 00000100:00100000:3.0:1787387740.088549:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:3.0:1787387740.088561:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690783232:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387740.088661:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690783232:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 102us (2748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387740.088668:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00080000:0.0:1787387740.088966:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387740.089062:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690783104 00000100:00100000:2.0:1787387740.089069:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690783104 00000100:00100000:2.0:1787387740.089111:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 203 00000100:00100000:2.0:1787387740.089119:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690783104:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387740.089198:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690783104:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 80us (8914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387740.089205:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 203 00010000:00010000:2.0:1787387740.514449:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387740.766113:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709690496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387740.766188:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387740.766317:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709690496 00000100:00100000:0.0:1787387740.766326:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709690496 00000100:00100000:0.0:1787387740.766454:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787387740.766465:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709690496:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787387740.766498:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1787387740.766501:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387740.766560:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709690496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387740.766567:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787387740.766655:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4350d1df80 x1874211709690496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387740.766687:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709690496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387740.767021:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387740.769571:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709690752:0@lo:400:kworker.0 00000100:00100000:2.0:1787387740.769646:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387740.769728:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709690624:0@lo:400:kworker.0 00000100:00100000:2.0:1787387740.769781:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387740.771065:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709690624 00000100:00100000:1.0:1787387740.771077:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709690624 00000100:00100000:1.0:1787387740.771135:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787387740.771145:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709690624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387740.771211:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709690624:12345-0@lo:400:kworker.0 Request processed in 68us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387740.771220:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787387740.772833:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709690624:0@lo:400:kworker.0 00000100:00100000:0.0:1787387740.772939:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709690752 00000100:00100000:0.0:1787387740.772947:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709690752 00000100:00100000:0.0:1787387740.773002:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787387740.773010:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709690752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387740.773112:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709690752:12345-0@lo:400:kworker.0 Request processed in 103us (3467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387740.773120:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787387740.773315:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709690752:0@lo:400:kworker.0 00000100:00100000:0.0:1787387740.774446:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709691136:0@lo:400:kworker.0 00000100:00100000:0.0:1787387740.774492:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387740.774529:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709691136 00000100:00100000:0.0:1787387740.774535:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709691136 00000100:00100000:0.0:1787387740.774584:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787387740.774592:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709691136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387740.774631:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709691136:12345-0@lo:400:kworker.0 Request processed in 40us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387740.774637:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787387740.774863:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709691136:0@lo:400:kworker.0 00000100:00100000:2.0:1787387740.774956:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709690880:0@lo:400:kworker.0 00000100:00100000:2.0:1787387740.774986:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387740.775017:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387740.775032:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709691008:0@lo:400:kworker.0 00000100:00100000:2.0:1787387740.775067:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387740.775099:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709691008 00000100:00100000:2.0:1787387740.775103:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709691008 00000100:00100000:2.0:1787387740.775139:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787387740.775145:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709691008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387740.775186:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709691008:12345-0@lo:400:kworker.0 Request processed in 41us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387740.775192:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787387740.775207:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387740.775211:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787387740.775229:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4350d1e680 x1874211709691008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387740.775239:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709691008:0@lo:400:kworker.0 00000100:00100000:0.0:1787387740.775299:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709690880 00000100:00100000:0.0:1787387740.775304:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709690880 00000100:00100000:0.0:1787387740.775341:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787387740.775348:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709690880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387740.775392:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709690880:12345-0@lo:400:kworker.0 Request processed in 45us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387740.775399:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787387740.775946:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387740.777553:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709690880:0@lo:400:kworker.0 00010000:00010000:0.0:1787387741.533938:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387741.790699:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387741.790724:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709691264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387741.790815:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387741.791116:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709691264 00000100:00100000:1.0:1787387741.791125:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709691264 00000100:00100000:1.0:1787387741.791190:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787387741.791200:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709691264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787387741.791236:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387741.791294:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709691264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387741.791302:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787387741.792701:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4343524000 x1874211709691264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387741.792725:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709691264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787387742.566397:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787387742.857618:0:9312:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.111 00010000:00010000:0.0:1787387743.582697:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387744.606312:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787387744.757357:0:9361:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 04:35:43 EDT 2026 00000100:00100000:0.0:1787387745.194672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387745.194721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387745.194934:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690783488 00000100:00100000:1.0:1787387745.194954:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690783488 00000100:00100000:1.0:1787387745.195026:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:1.0:1787387745.195036:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690783488:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387745.195123:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690783488:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 88us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387745.195131:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00080000:0.0:1787387745.195660:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387745.195786:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690783360 00000100:00100000:3.0:1787387745.195793:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690783360 00000100:00100000:3.0:1787387745.195845:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 205 00000100:00100000:3.0:1787387745.195854:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690783360:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387745.196224:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690783360:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 370us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387745.196232:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 205 00010000:00010000:0.0:1787387745.632214:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387745.886106:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709691648:0@lo:400:kworker.0 00000100:00100000:1.0:1787387745.886177:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387745.886237:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387745.886243:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709691776:0@lo:400:kworker.0 00000100:00100000:1.0:1787387745.886291:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387745.886371:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709691392:0@lo:400:kworker.0 00000100:00100000:2.0:1787387745.886405:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387745.886441:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709691904:0@lo:400:kworker.0 00000100:00100000:2.0:1787387745.886463:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387745.886480:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787387745.886486:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709691520:0@lo:400:kworker.0 00000100:00100000:2.0:1787387745.886505:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387745.886524:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709692032:0@lo:400:kworker.0 00000100:00100000:2.0:1787387745.886553:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387745.886586:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709691776 00000100:00100000:2.0:1787387745.886595:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709691776 00000100:00100000:2.0:1787387745.886650:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709692032 00000100:00100000:2.0:1787387745.886654:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709692032 00000100:00100000:2.0:1787387745.886672:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787387745.886681:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709691776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387745.886733:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709691776:12345-0@lo:400:kworker.0 Request processed in 53us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387745.886776:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787387745.886793:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787387745.886800:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709692032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387745.886836:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709692032:12345-0@lo:400:kworker.0 Request processed in 37us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387745.886842:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787387745.886858:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709691648 00000100:00100000:2.0:1787387745.886862:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709691648 00000100:00100000:2.0:1787387745.886886:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709691904 00000100:00100000:2.0:1787387745.886889:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709691904 00000100:00100000:2.0:1787387745.886901:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709691520 00000100:00100000:2.0:1787387745.886904:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709691520 00000100:00100000:2.0:1787387745.886915:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787387745.886921:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709691648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387745.886962:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709691648:12345-0@lo:400:kworker.0 Request processed in 41us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387745.886969:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787387745.886981:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787387745.886986:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709691904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387745.887012:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709691904:12345-0@lo:400:kworker.0 Request processed in 26us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387745.887026:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787387745.887038:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787387745.887044:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709691520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387745.887071:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709691520:12345-0@lo:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387745.887077:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787387745.887120:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709691520:0@lo:400:kworker.0 00010000:00080000:2.0:1787387745.887133:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43720a9f80 x1874211709692032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387745.887142:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709692032:0@lo:400:kworker.0 00000100:00100000:2.0:1787387745.887152:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709691904:0@lo:400:kworker.0 00010000:00080000:2.0:1787387745.887181:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43720a8380 x1874211709691776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387745.887190:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709691776:0@lo:400:kworker.0 00000100:00100000:2.0:1787387745.887198:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709691648:0@lo:400:kworker.0 00000100:00080000:0.0:1787387745.887376:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787387745.887381:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787387745.887383:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387745.887423:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387745.887433:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709692160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387745.887461:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387745.887485:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709692160 00000100:00100000:0.0:1787387745.887489:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709692160 00000100:00100000:0.0:1787387745.887512:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787387745.887517:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709692160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387745.887544:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387745.887576:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709692160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387745.887582:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787387745.887607:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4350d1f800 x1874211709692160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387745.887620:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709692160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387745.888792:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709691392 00000100:00100000:1.0:1787387745.888802:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709691392 00000100:00100000:1.0:1787387745.888848:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787387745.888856:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709691392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387745.888939:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709691392:12345-0@lo:400:kworker.0 Request processed in 84us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387745.888945:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787387745.889116:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709691392:0@lo:400:kworker.0 00010000:00010000:1.0:1787387746.654172:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387746.918779:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387746.918802:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709692288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387746.918872:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387746.918951:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709692288 00000100:00100000:2.0:1787387746.918960:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709692288 00000100:00100000:2.0:1787387746.919008:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787387746.919020:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709692288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387746.919058:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387746.920929:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709692288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1909us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387746.920940:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787387746.921172:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a087b80 x1874211709692288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387746.921197:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709692288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387747.680010:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387748.702248:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387749.727232:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387750.315289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387750.315338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387750.315443:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690783744 00000100:00100000:2.0:1787387750.315453:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690783744 00000100:00100000:2.0:1787387750.315530:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:2.0:1787387750.315542:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690783744:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387750.315627:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690783744:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 88us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387750.315636:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:3.0:1787387750.315782:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690783616 00000100:00100000:3.0:1787387750.315787:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690783616 00000100:00100000:3.0:1787387750.315819:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 207 00000100:00100000:3.0:1787387750.315826:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2350:x1874211690783616:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387750.315865:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2350:x1874211690783616:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 40us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387750.315871:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 207 00000100:00080000:0.0:1787387750.315990:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787387750.769785:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387751.006073:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709692416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387751.006143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387751.006236:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709692416 00000100:00100000:0.0:1787387751.006244:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709692416 00000100:00100000:0.0:1787387751.006307:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787387751.006317:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709692416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387751.006356:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387751.006402:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709692416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387751.006409:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787387751.006430:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787387751.006463:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4350d1ce00 x1874211709692416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387751.006482:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709692416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387751.007309:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709692544:0@lo:400:kworker.0 00000100:00100000:2.0:1787387751.007356:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387751.007401:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709692544 00000100:00100000:2.0:1787387751.007406:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709692544 00000100:00100000:2.0:1787387751.007437:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787387751.007444:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709692544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387751.007483:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709692544:12345-0@lo:400:kworker.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387751.007489:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787387751.007529:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709692544:0@lo:400:kworker.0 00000100:00100000:2.0:1787387751.007568:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709692672:0@lo:400:kworker.0 00000100:00100000:2.0:1787387751.007594:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387751.007784:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709692672 00000100:00100000:2.0:1787387751.007789:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709692672 00000100:00100000:2.0:1787387751.007818:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787387751.007849:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709692672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387751.007885:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709692672:12345-0@lo:400:kworker.0 Request processed in 37us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387751.007891:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787387751.007918:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709692672:0@lo:400:kworker.0 00000100:00100000:2.0:1787387751.007950:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709692800:0@lo:400:kworker.0 00000100:00100000:2.0:1787387751.007974:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387751.008000:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709692800 00000100:00100000:2.0:1787387751.008004:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709692800 00000100:00100000:2.0:1787387751.008030:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787387751.008037:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709692800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387751.008070:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709692800:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387751.008076:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787387751.008101:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709692800:0@lo:400:kworker.0 00000100:00100000:2.0:1787387751.008130:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709692928:0@lo:400:kworker.0 00000100:00100000:2.0:1787387751.008155:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387751.008182:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709692928 00000100:00100000:2.0:1787387751.008185:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709692928 00000100:00100000:2.0:1787387751.008208:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787387751.008215:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709692928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387751.008248:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709692928:12345-0@lo:400:kworker.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387751.008254:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787387751.008528:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787387751.008532:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387751.017763:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709693056:0@lo:400:kworker.0 00000100:00100000:3.0:1787387751.017850:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387751.017961:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709693056 00000100:00100000:1.0:1787387751.017972:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709693056 00000100:00100000:1.0:1787387751.018034:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787387751.018043:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709693056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387751.018098:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709693056:12345-0@lo:400:kworker.0 Request processed in 56us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387751.018104:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787387751.018723:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387751.018781:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709693056:0@lo:400:kworker.0 00010000:00080000:2.0:1787387751.019447:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a086a00 x1874211709692928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387751.019472:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709692928:0@lo:400:kworker.0 00010000:00010000:2.0:1787387751.778830:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387752.032005:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387752.032030:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709693184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387752.032098:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387752.032161:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709693184 00000100:00100000:3.0:1787387752.032168:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709693184 00000100:00100000:3.0:1787387752.032215:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787387752.032224:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709693184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787387752.032798:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387752.032856:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709693184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 633us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387752.032863:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787387752.032906:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a5d9180 x1874211709693184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387752.032923:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709693184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787387752.802514:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387753.823481:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387754.848345:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387755.433536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387755.433585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387755.433769:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690784000 00000100:00100000:2.0:1787387755.433782:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690784000 00000100:00100000:2.0:1787387755.433864:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:2.0:1787387755.433874:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690784000:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387755.433948:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690784000:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 75us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387755.433955:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00080000:0.0:1787387755.434018:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387755.436190:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690783872 00000100:00100000:3.0:1787387755.436205:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690783872 00000100:00100000:3.0:1787387755.436268:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 209 00000100:00100000:3.0:1787387755.436279:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690783872:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387755.436362:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2351:x1874211690783872:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 84us (2835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387755.436369:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 209 00010000:00010000:3.0:1787387755.871450:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387756.126017:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709693312:0@lo:400:kworker.0 00000100:00100000:1.0:1787387756.126118:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387756.126239:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709693312 00000100:00100000:2.0:1787387756.126251:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709693312 00000100:00100000:2.0:1787387756.126332:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787387756.126344:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709693312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387756.130204:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709693312:12345-0@lo:400:kworker.0 Request processed in 3848us (4072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387756.130225:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787387756.130674:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709693312:0@lo:400:kworker.0 00000100:00100000:1.0:1787387756.130719:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709693824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387756.130836:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387756.130865:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709693440:0@lo:400:kworker.0 00000100:00100000:1.0:1787387756.130886:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387756.130896:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709693696:0@lo:400:kworker.0 00000100:00100000:2.0:1787387756.130907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387756.130931:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387756.130940:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387756.130951:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709693568:0@lo:400:kworker.0 00000100:00100000:1.0:1787387756.130976:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709693824 00000100:00100000:2.0:1787387756.130982:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387756.130985:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709693824 00000100:00100000:2.0:1787387756.131020:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709693440 00000100:00100000:2.0:1787387756.131025:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709693440 00000100:00100000:2.0:1787387756.131075:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709693568 00000100:00100000:2.0:1787387756.131098:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709693568 00000100:00100000:1.0:1787387756.131141:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787387756.131146:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787387756.131153:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709693824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387756.131159:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709693440:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787387756.131204:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387756.131219:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709693440:12345-0@lo:400:kworker.0 Request processed in 64us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387756.131227:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787387756.131247:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787387756.131252:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709693824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387756.131262:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787387756.131288:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709693696 00000100:00100000:1.0:1787387756.131299:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709693696 00000100:00100000:1.0:1787387756.131396:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787387756.131403:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709693696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387756.131438:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709693696:12345-0@lo:400:kworker.0 Request processed in 35us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387756.131444:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787387756.131462:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387756.131467:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787387756.131469:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787387756.131502:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a5da300 x1874211709693696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387756.131515:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709693696:0@lo:400:kworker.0 00010000:00080000:1.0:1787387756.131526:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4350d1e680 x1874211709693824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387756.131540:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709693824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387756.133366:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709693568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387756.133502:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709693568:12345-0@lo:400:kworker.0 Request processed in 2242us (2516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387756.133517:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787387756.133552:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387756.133571:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709693952:0@lo:400:kworker.0 00000100:00100000:2.0:1787387756.133606:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709693568:0@lo:400:kworker.0 00000100:00100000:3.0:1787387756.133623:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387756.133628:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709693440:0@lo:400:kworker.0 00000100:00100000:1.0:1787387756.133716:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709693952 00000100:00100000:1.0:1787387756.133732:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709693952 00000100:00100000:1.0:1787387756.133830:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787387756.133840:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709693952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387756.133878:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709693952:12345-0@lo:400:kworker.0 Request processed in 40us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387756.133885:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787387756.133924:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709693952:0@lo:400:kworker.0 00000100:00080000:2.0:1787387756.133934:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787387756.894001:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387757.151038:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387757.151072:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709694080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387757.151183:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387757.151265:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709694080 00000100:00100000:2.0:1787387757.151274:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709694080 00000100:00100000:2.0:1787387757.151333:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787387757.151351:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709694080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387757.151398:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387757.151448:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709694080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387757.151456:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787387757.151509:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a087480 x1874211709694080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387757.151550:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709694080:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787387757.919544:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387758.941912:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387759.966003:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387760.558793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387760.558880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387760.559182:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690784256 00000100:00100000:2.0:1787387760.559194:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690784256 00000100:00100000:2.0:1787387760.559276:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:2.0:1787387760.559287:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690784256:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387760.559366:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690784256:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 81us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387760.559373:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690784128 00000100:00100000:2.0:1787387760.559374:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:3.0:1787387760.559377:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690784128 00000100:00100000:3.0:1787387760.559402:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 211 00000100:00100000:3.0:1787387760.559408:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2350:x1874211690784128:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387760.559444:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2350:x1874211690784128:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 36us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387760.559451:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 211 00000100:00080000:1.0:1787387760.559761:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787387760.991770:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387761.249515:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709694336:0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.249598:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387761.249670:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709694848:0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.249696:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387761.249726:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787387761.249732:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709694208:0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.249777:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387761.249797:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709694720:0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.249818:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387761.249842:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709694592:0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.249863:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387761.249881:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387761.249886:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709694464:0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.249908:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387761.249933:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709694336 00000100:00100000:1.0:1787387761.249940:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709694336 00000100:00100000:1.0:1787387761.249993:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709694720 00000100:00100000:1.0:1787387761.249996:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709694720 00000100:00100000:1.0:1787387761.250018:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709694464 00000100:00100000:1.0:1787387761.250020:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709694464 00000100:00100000:1.0:1787387761.250037:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787387761.250046:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709694336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.250115:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709694336:12345-0@lo:400:kworker.0 Request processed in 70us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387761.250124:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787387761.250161:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387761.250167:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709694720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.250197:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709694720:12345-0@lo:400:kworker.0 Request processed in 31us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387761.250203:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387761.250214:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787387761.250220:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709694464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.250251:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709694464:12345-0@lo:400:kworker.0 Request processed in 32us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387761.250257:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787387761.250275:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709694848 00000100:00100000:1.0:1787387761.250278:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709694848 00000100:00100000:1.0:1787387761.250303:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709694592 00000100:00100000:1.0:1787387761.250306:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709694592 00000100:00100000:1.0:1787387761.250321:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787387761.250326:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709694848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.250357:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709694848:12345-0@lo:400:kworker.0 Request processed in 31us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387761.250364:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787387761.250375:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787387761.250382:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709694592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.250407:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709694592:12345-0@lo:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387761.250413:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787387761.250431:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387761.250435:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387761.250437:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387761.250474:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709694464:0@lo:400:kworker.0 00010000:00080000:1.0:1787387761.250489:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437ab85180 x1874211709694592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387761.250499:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709694592:0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.250531:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709694720:0@lo:400:kworker.0 00000100:00100000:1.0:1787387761.250541:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709694336:0@lo:400:kworker.0 00010000:00080000:1.0:1787387761.250550:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437ab87b80 x1874211709694848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387761.250557:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709694848:0@lo:400:kworker.0 00000100:00100000:2.0:1787387761.251073:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709694208 00000100:00100000:2.0:1787387761.251092:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709694208 00000100:00100000:2.0:1787387761.251135:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787387761.251143:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709694208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387761.251196:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709694208:12345-0@lo:400:kworker.0 Request processed in 54us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387761.251202:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787387761.251471:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387761.251485:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709694976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387761.251520:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387761.254205:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709694976 00000100:00100000:0.0:1787387761.254219:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709694976 00000100:00100000:0.0:1787387761.254294:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787387761.254304:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709694976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387761.254343:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387761.254420:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709694976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387761.254444:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787387761.254469:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4350d1df80 x1874211709694976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387761.254490:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709694976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387761.255504:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709694208:0@lo:400:kworker.0 00010000:00010000:3.0:1787387762.014845:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387762.279079:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709695104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387762.279180:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387762.280073:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709695104 00000100:00100000:0.0:1787387762.280087:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709695104 00000100:00100000:0.0:1787387762.280155:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787387762.280167:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709695104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787387762.280216:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387762.280294:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709695104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387762.280302:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787387762.280391:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a5db100 x1874211709695104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387762.280414:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709695104:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787387762.432540:0:9990:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:36:00 (1787387760) === 00000100:00100000:2.0:1787387762.946622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387762.946721:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690784384 00000100:00100000:3.0:1787387762.946731:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690784384 00000100:00100000:3.0:1787387762.946819:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 213 00000100:00100000:3.0:1787387762.946830:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:8113:x1874211690784384:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787387762.946847:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387762.946865:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c76d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52784 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387762.946896:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c76d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52784 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387762.946926:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c76d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52784 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387762.946936:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152fa00, rc 0) 00000100:00100000:3.0:1787387762.947004:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:8113:x1874211690784384:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 176us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387762.947011:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 213 00000100:00100000:0.0:1787387762.957164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387762.957274:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690784512 00000100:00100000:3.0:1787387762.957284:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690784512 00000100:00100000:3.0:1787387762.957349:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 214 00000100:00100000:3.0:1787387762.957361:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:8113:x1874211690784512:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787387762.957705:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:8113:x1874211690784512:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 345us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387762.957713:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 214 00000100:00100000:1.0:1787387762.963932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387762.964048:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690784640 00000100:00100000:2.0:1787387762.964059:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690784640 00000100:00100000:2.0:1787387762.964124:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 215 00000100:00100000:2.0:1787387762.964135:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:8113:x1874211690784640:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787387762.964403:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:8113:x1874211690784640:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 269us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387762.964412:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 215 00000100:00100000:0.0:1787387762.981136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387762.981375:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690784768 00000100:00100000:2.0:1787387762.981386:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690784768 00000100:00100000:2.0:1787387762.981452:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 216 00000100:00100000:2.0:1787387762.981462:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:8117:x1874211690784768:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787387762.981810:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:8117:x1874211690784768:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 348us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387762.981819:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 216 00000100:00100000:0.0:1787387763.008935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387763.009030:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690784896 00000100:00100000:3.0:1787387763.009050:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690784896 00000100:00100000:3.0:1787387763.009114:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 217 00000100:00100000:3.0:1787387763.009125:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:8117:x1874211690784896:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787387763.009405:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:8117:x1874211690784896:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 281us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387763.009413:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 217 00000100:00100000:1.0:1787387763.025720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387763.025883:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690785024 00000100:00100000:0.0:1787387763.025893:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690785024 00000100:00100000:0.0:1787387763.025951:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 218 00000100:00100000:0.0:1787387763.025960:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:8113:x1874211690785024:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787387763.025976:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387763.025994:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4340030c00/0x93d41aeaa23c76de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b527ae expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387763.026022:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340030c00/0x93d41aeaa23c76de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527ae expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387763.026045:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4340030c00/0x93d41aeaa23c76de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527ae expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387763.026055:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340030c00, rc 0) 00000100:00100000:0.0:1787387763.026133:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:8113:x1874211690785024:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 173us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387763.026141:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 218 00000100:00100000:0.0:1787387763.030874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387763.030980:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690785152 00000100:00100000:2.0:1787387763.030991:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690785152 00000100:00100000:2.0:1787387763.031059:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 219 00000100:00100000:2.0:1787387763.031069:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:8113:x1874211690785152:12345-192.168.204.59@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787387763.031096:0:5802:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787387763.031129:0:5802:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787387763.031134:0:5802:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787387763.031137:0:5802:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787387763.031139:0:5802:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787387763.033837:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:8113:x1874211690785152:12345-192.168.204.59@tcp:256:mount.lustre.0 Request processed in 2755us (2956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387763.033853:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 219 00000100:00100000:1.0:1787387763.036851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387763.036944:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690785280 00000100:00100000:3.0:1787387763.036955:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690785280 00000100:00100000:3.0:1787387763.037012:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 220 00000100:00100000:3.0:1787387763.037022:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:8113:x1874211690785280:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787387763.037061:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387763.037080:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152f600/0x93d41aeaa23c76e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b527b5 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387763.037116:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152f600/0x93d41aeaa23c76e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527b5 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387763.037129:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152f600/0x93d41aeaa23c76e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527b5 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387763.037138:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f600, rc 0) 00000100:00100000:3.0:1787387763.037203:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:8113:x1874211690785280:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 181us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387763.037210:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 220 00000100:00100000:3.0:1787387763.041054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387763.041322:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690785408 00000100:00100000:2.0:1787387763.041336:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690785408 00000100:00100000:2.0:1787387763.041395:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 221 00000100:00100000:2.0:1787387763.041406:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:8113:x1874211690785408:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787387763.041864:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:8113:x1874211690785408:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 459us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387763.041876:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 221 00010000:00010000:2.0:1787387763.044094:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387763.047367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387763.047671:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690785536 00000100:00100000:2.0:1787387763.047681:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690785536 00000100:00100000:2.0:1787387763.047766:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 222 00000100:00100000:2.0:1787387763.047777:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:8113:x1874211690785536:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787387763.048011:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:8113:x1874211690785536:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 235us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387763.048019:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 222 00000100:00100000:1.0:1787387763.054158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387763.054404:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690785664 00000100:00100000:3.0:1787387763.054414:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690785664 00000100:00100000:3.0:1787387763.054474:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 223 00000100:00100000:3.0:1787387763.054484:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:8119:x1874211690785664:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787387763.054767:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:8119:x1874211690785664:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 282us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387763.054775:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 223 00000100:00100000:3.0:1787387763.062796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387763.062891:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690785792 00000100:00100000:2.0:1787387763.062902:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690785792 00000100:00100000:2.0:1787387763.062961:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00100000:2.0:1787387763.062971:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:8119:x1874211690785792:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787387763.063238:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:8119:x1874211690785792:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 267us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387763.063248:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00100000:1.0:1787387763.069879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387763.070526:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690785920 00000100:00100000:2.0:1787387763.070537:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690785920 00000100:00100000:2.0:1787387763.070603:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:2.0:1787387763.070613:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2349:x1874211690785920:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787387763.070645:0:5807:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 130c956a-3dfa-4a85-a4d5-15465fdee9cd@192.168.204.59@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:2.0:1787387763.070688:0:5807:0:(genops.c:1406:class_connect()) connect: client 130c956a-3dfa-4a85-a4d5-15465fdee9cd, cookie 0x93d41aeaa23c76ec 00000004:00100000:2.0:1787387763.070721:0:5807:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1787387763.071046:0:5807:0:(import.c:65:import_set_state_nolock()) ffff8d437a1bf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387763.071127:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:2349:x1874211690785920:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 512us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387763.071135:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1787387763.074359:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387763.074448:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690786304 00000100:00100000:2.0:1787387763.074459:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690786304 00000100:00100000:2.0:1787387763.074546:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:2.0:1787387763.074557:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690786304:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387763.074654:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690786304:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 99us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387763.074662:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00080000:1.0:1787387763.077717:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387763.079547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387763.079696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387763.080722:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690786176 00000100:00100000:2.0:1787387763.080722:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690786048 00000100:00100000:3.0:1787387763.080734:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690786176 00000100:00100000:2.0:1787387763.080734:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690786048 00000100:00100000:2.0:1787387763.080819:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1787387763.080829:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+7:0:x1874211690786048:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787387763.080873:0:5807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787387763.080884:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:3.0:1787387763.080892:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+7:8113:x1874211690786176:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787387763.080917:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787387763.080961:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+7:0:x1874211690786048:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 133us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387763.080969:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00080000:1.0:1787387763.081034:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387763.081929:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:8113:x1874211690786176:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 1035us (2229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387763.081938:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:3.0:1787387763.084570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387763.084696:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690786432 00000100:00100000:0.0:1787387763.084706:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690786432 00000100:00100000:0.0:1787387763.084805:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1787387763.084816:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:8113:x1874211690786432:12345-192.168.204.59@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787387763.084941:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:8113:x1874211690786432:12345-192.168.204.59@tcp:40:mount.lustre.0 Request processed in 127us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387763.084949:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:1.0:1787387763.087727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387763.087874:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690786560 00000100:00100000:2.0:1787387763.087883:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690786560 00000100:00100000:2.0:1787387763.087929:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:2.0:1787387763.087938:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874211690786560:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787387763.087968:0:6606:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 130c956a-3dfa-4a85-a4d5-15465fdee9cd@192.168.204.59@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:2.0:1787387763.088001:0:6606:0:(genops.c:1406:class_connect()) connect: client 130c956a-3dfa-4a85-a4d5-15465fdee9cd, cookie 0x93d41aeaa23c76f3 00002000:00100000:2.0:1787387763.088012:0:6606:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 130c956a-3dfa-4a85-a4d5-15465fdee9cd/ffff8d437a1b9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787387763.088024:0:6606:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1787387763.088292:0:6606:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787387763.088320:0:6606:0:(import.c:65:import_set_state_nolock()) ffff8d437a1ba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387763.088405:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:2349:x1874211690786560:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 467us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387763.088413:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:3.0:1787387763.090874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387763.090983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387763.091087:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690786816 00000100:00100000:0.0:1787387763.091097:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690786816 00000100:00100000:0.0:1787387763.091331:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1787387763.091342:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:8113:x1874211690786816:12345-192.168.204.59@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787387763.091854:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787387763.091879:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690786688 00000100:00100000:2.0:1787387763.091885:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690786688 00000100:00100000:2.0:1787387763.091920:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:2.0:1787387763.091927:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1874211690786688:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787387763.091951:0:6604:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 130c956a-3dfa-4a85-a4d5-15465fdee9cd@192.168.204.59@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:2.0:1787387763.091978:0:6604:0:(genops.c:1406:class_connect()) connect: client 130c956a-3dfa-4a85-a4d5-15465fdee9cd, cookie 0x93d41aeaa23c76fa 00002000:00100000:2.0:1787387763.091989:0:6604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 130c956a-3dfa-4a85-a4d5-15465fdee9cd/ffff8d437a1bc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1787387763.092003:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:8113:x1874211690786816:12345-192.168.204.59@tcp:33:mount.lustre.0 Request processed in 663us (1019us total) trans 0 rc 0/0 00002000:00100000:2.0:1787387763.092010:0:6604:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00000100:00100000:0.0:1787387763.092010:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00002000:00080000:2.0:1787387763.092400:0:6604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787387763.092427:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d437a1be000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387763.092459:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:2349:x1874211690786688:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 531us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387763.092466:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000001:00100000:2.0:1787387763.945448:0:7514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 130c956a-3dfa-4a85-a4d5-15465fdee9cd 00010000:00010000:3.0:1787387764.062038:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787387764.919122:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 130c956a-3dfa-4a85-a4d5-15465fdee9cd 00010000:00010000:0.0:1787387765.090180:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387766.112284:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387766.368039:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709695232:0@lo:400:kworker.0 00000100:00100000:2.0:1787387766.368117:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387766.368184:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709695744:0@lo:400:kworker.0 00000100:00100000:2.0:1787387766.368212:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387766.368242:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787387766.368247:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709695360:0@lo:400:kworker.0 00000100:00100000:2.0:1787387766.368268:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387766.368295:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709695872:0@lo:400:kworker.0 00000100:00100000:2.0:1787387766.368322:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387766.368358:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709695744 00000100:00100000:2.0:1787387766.368366:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709695744 00000100:00100000:2.0:1787387766.368417:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709695360 00000100:00100000:2.0:1787387766.368420:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709695360 00000100:00100000:2.0:1787387766.368443:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787387766.368451:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709695744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387766.368531:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709695744:12345-0@lo:400:kworker.0 Request processed in 69us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387766.368539:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787387766.368557:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787387766.368564:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709695360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387766.368593:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709695360:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387766.368599:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787387766.368617:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709695872 00000100:00100000:2.0:1787387766.368621:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709695872 00000100:00100000:2.0:1787387766.368646:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787387766.368652:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709695872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387766.368682:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709695872:12345-0@lo:400:kworker.0 Request processed in 30us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387766.368688:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787387766.368703:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787387766.368708:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387766.368764:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709695360:0@lo:400:kworker.0 00010000:00080000:2.0:1787387766.368780:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345014700 x1874211709695872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387766.368799:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709695872:0@lo:400:kworker.0 00000100:00100000:2.0:1787387766.368811:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709695744:0@lo:400:kworker.0 00000100:00100000:3.0:1787387766.369237:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709695488:0@lo:400:kworker.0 00000100:00100000:3.0:1787387766.369273:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387766.369295:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387766.369301:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709695616:0@lo:400:kworker.0 00000100:00100000:3.0:1787387766.369323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387766.369354:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709695488 00000100:00100000:3.0:1787387766.369358:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709695488 00000100:00100000:3.0:1787387766.369389:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787387766.369396:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709695488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387766.369441:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709695488:12345-0@lo:400:kworker.0 Request processed in 45us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387766.369447:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787387766.369479:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709695616 00000100:00100000:3.0:1787387766.369483:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709695616 00000100:00100000:3.0:1787387766.369507:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787387766.369513:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709695616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387766.369553:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709695616:12345-0@lo:400:kworker.0 Request processed in 40us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387766.369570:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787387766.369597:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387766.369600:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787387766.369620:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345014a80 x1874211709695616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387766.369630:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709695616:0@lo:400:kworker.0 00000100:00100000:3.0:1787387766.369640:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709695488:0@lo:400:kworker.0 00000100:00100000:3.0:1787387766.370028:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387766.370038:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709696000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387766.370069:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387766.370101:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709696000 00000100:00100000:3.0:1787387766.370106:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709696000 00000100:00100000:3.0:1787387766.370131:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787387766.370138:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709696000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787387766.370167:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387766.370200:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709696000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387766.370206:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787387766.370248:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a085880 x1874211709696000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387766.370262:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709696000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387766.370787:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709695232 00000100:00100000:0.0:1787387766.370793:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709695232 00000100:00100000:0.0:1787387766.370824:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787387766.370832:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709695232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387766.370890:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709695232:12345-0@lo:400:kworker.0 Request processed in 59us (2774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387766.370896:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787387766.371162:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709695232:0@lo:400:kworker.0 00000001:00100000:0.0:1787387767.003381:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 130c956a-3dfa-4a85-a4d5-15465fdee9cd 00010000:00010000:0.0:1787387767.134884:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387767.390094:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387767.390121:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709696128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387767.390198:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387767.390392:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709696128 00000100:00100000:3.0:1787387767.390400:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709696128 00000100:00100000:3.0:1787387767.390455:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787387767.390465:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709696128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787387767.400399:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387767.400533:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709696128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10065us (10330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387767.400543:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787387767.400687:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a5d8000 x1874211709696128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387767.400713:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709696128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787387768.161052:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387768.235139:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387768.235203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387768.235247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387768.235251:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690786944 00000100:00100000:2.0:1787387768.235265:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690786944 00000100:00100000:3.0:1787387768.235278:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387768.235333:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690787072 00000100:00100000:1.0:1787387768.235338:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690787200 00000100:00100000:0.0:1787387768.235340:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690787072 00000100:00100000:3.0:1787387768.235345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387768.235351:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 226 00000100:00100000:1.0:1787387768.235365:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690787200 00000100:00100000:3.0:1787387768.235376:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690787328 00000100:00100000:3.0:1787387768.235389:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690787328 00000100:00100000:0.0:1787387768.235400:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:0.0:1787387768.235412:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2352:x1874211690787072:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387768.235435:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690787456 00000100:00100000:3.0:1787387768.235438:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690787456 00000100:00100000:3.0:1787387768.235472:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1787387768.235481:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:3.0:1787387768.235495:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690787328:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387768.235518:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690787200:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387768.235536:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690787328:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 53us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387768.235536:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2352:x1874211690787072:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 124us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387768.235554:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:0.0:1787387768.235564:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:2.0:1787387768.235575:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690786944:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387768.235582:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00080000:0.0:1787387768.235590:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387768.235591:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690787456:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:0.0:1787387768.235596:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787387768.235600:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387768.235618:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690786944:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 50us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387768.235626:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690787456:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 35us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387768.235629:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 226 00000100:00100000:3.0:1787387768.235639:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:1.0:1787387768.235821:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690787200:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 317us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387768.235832:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00010000:00010000:1.0:1787387769.186721:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787387769.479957:0:10190:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787387770.206240:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387771.235014:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387771.486007:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709696512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387771.486085:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387771.486169:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709696256:0@lo:400:kworker.0 00000100:00100000:3.0:1787387771.486228:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387771.486274:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709696768:0@lo:400:kworker.0 00000100:00100000:3.0:1787387771.486315:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387771.486347:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787387771.486468:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709696640:0@lo:400:kworker.0 00000100:00100000:1.0:1787387771.486502:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387771.486523:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387771.486529:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709697024:0@lo:400:kworker.0 00000100:00100000:1.0:1787387771.486549:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387771.486578:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709696640 00000100:00100000:1.0:1787387771.486586:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709696640 00000100:00100000:1.0:1787387771.486647:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787387771.486657:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709696640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387771.486711:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709696640:12345-0@lo:400:kworker.0 Request processed in 55us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387771.486719:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787387771.486771:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709696768 00000100:00100000:1.0:1787387771.486775:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709696768 00000100:00100000:1.0:1787387771.486802:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709697024 00000100:00100000:1.0:1787387771.486806:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709697024 00000100:00100000:1.0:1787387771.486822:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787387771.486829:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709696768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387771.486860:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709696768:12345-0@lo:400:kworker.0 Request processed in 31us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387771.486866:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787387771.486886:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787387771.486892:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709697024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387771.486920:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709697024:12345-0@lo:400:kworker.0 Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387771.486926:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787387771.486941:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387771.486945:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387771.486947:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787387771.486979:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345015f80 x1874211709697024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387771.486994:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709697024:0@lo:400:kworker.0 00000100:00100000:1.0:1787387771.487005:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709696640:0@lo:400:kworker.0 00000100:00100000:1.0:1787387771.487037:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709696256 00000100:00100000:1.0:1787387771.487040:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709696256 00000100:00100000:1.0:1787387771.487063:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787387771.487069:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709696256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387771.487096:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709696256:12345-0@lo:400:kworker.0 Request processed in 27us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387771.487101:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787387771.488247:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709696384:0@lo:400:kworker.0 00000100:00100000:3.0:1787387771.488301:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387771.488337:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709696896:0@lo:400:kworker.0 00000100:00100000:3.0:1787387771.488376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387771.488416:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709696256:0@lo:400:kworker.0 00010000:00080000:3.0:1787387771.488440:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345017100 x1874211709696768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387771.488451:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709696768:0@lo:400:kworker.0 00000100:00100000:2.0:1787387771.488733:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709696384 00000100:00100000:2.0:1787387771.488758:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709696384 00000100:00100000:2.0:1787387771.488800:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709696896 00000100:00100000:2.0:1787387771.488804:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709696896 00000100:00100000:2.0:1787387771.488846:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787387771.488854:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709696384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387771.488899:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709696384:12345-0@lo:400:kworker.0 Request processed in 46us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387771.488906:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787387771.488920:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787387771.488926:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709696896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387771.488952:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709696896:12345-0@lo:400:kworker.0 Request processed in 26us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387771.488957:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1787387771.488971:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387771.492582:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709696384:0@lo:400:kworker.0 00000100:00100000:3.0:1787387771.492600:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709696896:0@lo:400:kworker.0 00000100:00100000:0.0:1787387771.495599:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709696512 00000100:00100000:0.0:1787387771.495615:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709696512 00000100:00100000:0.0:1787387771.495693:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787387771.495702:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709696512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387771.495758:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387771.495921:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709696512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 220us (9835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387771.495929:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787387771.501374:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a086300 x1874211709696512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387771.501407:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709696512:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787387772.254698:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387772.511507:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387772.511528:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709697152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387772.511590:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387772.511648:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709697152 00000100:00100000:3.0:1787387772.511655:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709697152 00000100:00100000:3.0:1787387772.511696:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787387772.511704:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709697152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787387772.511764:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387772.511806:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709697152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387772.511818:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787387772.511874:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43746a0e00 x1874211709697152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387772.511891:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709697152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787387773.284081:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387773.355933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387773.355972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387773.355999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387773.356025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387773.356052:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387773.356082:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690788096 00000100:00100000:3.0:1787387773.356091:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690788096 00000100:00100000:3.0:1787387773.356149:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690787968 00000100:00100000:3.0:1787387773.356152:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690787968 00000100:00100000:3.0:1787387773.356171:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:3.0:1787387773.356182:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2353:x1874211690788096:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387773.356252:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2353:x1874211690788096:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 71us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387773.356260:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:3.0:1787387773.356277:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1787387773.356283:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2353:x1874211690787968:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387773.356310:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2353:x1874211690787968:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387773.356316:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1787387773.356333:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690787840 00000100:00100000:3.0:1787387773.356337:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690787840 00000100:00100000:3.0:1787387773.356380:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690787712 00000100:00100000:3.0:1787387773.356396:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690787712 00000100:00100000:3.0:1787387773.356419:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:3.0:1787387773.356425:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2353:x1874211690787840:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387773.356451:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2353:x1874211690787840:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387773.356457:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:3.0:1787387773.356467:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:3.0:1787387773.356473:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2353:x1874211690787712:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387773.356493:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2353:x1874211690787712:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 20us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387773.356499:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00080000:3.0:1787387773.356515:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387773.356519:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387773.356521:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387773.356823:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690787584 00000100:00100000:2.0:1787387773.356828:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690787584 00000100:00100000:2.0:1787387773.356854:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 228 00000100:00100000:2.0:1787387773.356861:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2353:x1874211690787584:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387773.356898:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2353:x1874211690787584:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 37us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387773.356905:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 228 00010000:00010000:3.0:1787387774.302374:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387775.331846:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387776.366076:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387776.606497:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709697280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387776.606573:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387776.606667:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709697280 00000100:00100000:2.0:1787387776.606681:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709697280 00000100:00100000:2.0:1787387776.606756:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787387776.606777:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709697280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787387776.606815:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387776.606865:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709697280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387776.606872:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787387776.606893:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787387776.606928:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a086300 x1874211709697280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387776.606945:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709697280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387776.610478:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709697536:0@lo:400:kworker.0 00000100:00100000:3.0:1787387776.610551:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387776.610587:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387776.610593:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709697664:0@lo:400:kworker.0 00000100:00100000:3.0:1787387776.610615:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387776.610655:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709697536 00000100:00100000:3.0:1787387776.610662:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709697536 00000100:00100000:3.0:1787387776.610707:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709697664 00000100:00100000:3.0:1787387776.610710:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709697664 00000100:00100000:3.0:1787387776.610758:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787387776.610777:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709697536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387776.610838:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709697536:12345-0@lo:400:kworker.0 Request processed in 72us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387776.610846:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787387776.610862:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787387776.610868:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709697664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387776.610892:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709697664:12345-0@lo:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387776.610898:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787387776.610937:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709697664:0@lo:400:kworker.0 00000100:00100000:3.0:1787387776.610947:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709697536:0@lo:400:kworker.0 00000100:00100000:1.0:1787387776.614182:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709697408:0@lo:400:kworker.0 00000100:00100000:1.0:1787387776.614262:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387776.614306:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709697920:0@lo:400:kworker.0 00000100:00100000:1.0:1787387776.614350:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387776.614387:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387776.614395:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709697792:0@lo:400:kworker.0 00000100:00100000:1.0:1787387776.614420:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387776.614450:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709697408 00000100:00100000:1.0:1787387776.614458:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709697408 00000100:00100000:1.0:1787387776.614502:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787387776.614511:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709697408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387776.614568:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709697408:12345-0@lo:400:kworker.0 Request processed in 58us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387776.614575:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787387776.614607:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709697792 00000100:00100000:1.0:1787387776.614611:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709697792 00000100:00100000:1.0:1787387776.614638:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787387776.614644:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709697792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387776.614676:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709697792:12345-0@lo:400:kworker.0 Request processed in 32us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387776.614682:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787387776.614708:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709697920 00000100:00100000:1.0:1787387776.614712:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709697920 00000100:00100000:1.0:1787387776.614767:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787387776.614775:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709697920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387776.614804:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709697920:12345-0@lo:400:kworker.0 Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387776.614810:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1787387776.614845:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43746a1c00 x1874211709697792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387776.614860:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709697792:0@lo:400:kworker.0 00000100:00100000:1.0:1787387776.614878:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709697408:0@lo:400:kworker.0 00000100:00100000:1.0:1787387776.614888:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709697920:0@lo:400:kworker.0 00000100:00080000:2.0:1787387776.619459:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387776.619469:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787387777.374165:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387777.630961:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387777.631002:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709698048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387777.631091:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387777.631383:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709698048 00000100:00100000:3.0:1787387777.631395:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709698048 00000100:00100000:3.0:1787387777.631461:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787387777.631472:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709698048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787387777.631517:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387777.631616:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709698048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387777.631625:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787387777.631694:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43746a3480 x1874211709698048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387777.631717:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709698048:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787387778.397979:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387778.477355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387778.477410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387778.477457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387778.477480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387778.477526:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387778.477559:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690788736 00000100:00100000:1.0:1787387778.477568:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690788736 00000100:00100000:0.0:1787387778.477653:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690788224 00000100:00100000:0.0:1787387778.477658:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690788224 00000100:00100000:0.0:1787387778.477696:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 230 00000100:00100000:0.0:1787387778.477712:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690788224:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387778.477812:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690788224:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 100us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387778.477820:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 230 00000100:00100000:0.0:1787387778.477977:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690788608 00000100:00100000:0.0:1787387778.477982:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690788608 00000100:00100000:0.0:1787387778.478008:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:0.0:1787387778.478015:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690788608:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387778.478045:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690788608:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387778.478050:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:0.0:1787387778.478066:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690788480 00000100:00100000:0.0:1787387778.478069:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690788480 00000100:00100000:0.0:1787387778.478090:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690788352 00000100:00100000:0.0:1787387778.478093:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690788352 00000100:00100000:0.0:1787387778.478109:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:0.0:1787387778.478114:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690788480:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387778.478140:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690788480:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387778.478146:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:0.0:1787387778.478157:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:0.0:1787387778.478162:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690788352:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387778.478191:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690788352:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 22us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387778.478197:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00080000:0.0:1787387778.478292:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787387778.478297:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787387778.478299:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787387778.478774:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:1.0:1787387778.478784:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690788736:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387778.478821:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690788736:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 40us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387778.478827:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00010000:00010000:1.0:1787387779.425909:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387780.446056:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387781.469881:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387781.726281:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709698560:0@lo:400:kworker.0 00000100:00100000:1.0:1787387781.726281:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709698176:0@lo:400:kworker.0 00000100:00100000:0.0:1787387781.726380:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709698304:0@lo:400:kworker.0 00000100:00100000:3.0:1787387781.730366:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387781.730462:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709698560 00000100:00100000:3.0:1787387781.730471:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709698560 00000100:00100000:3.0:1787387781.730530:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787387781.730554:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709698560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387781.730616:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709698560:12345-0@lo:400:kworker.0 Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387781.730624:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787387781.730904:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387781.730934:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709698688:0@lo:400:kworker.0 00000100:00100000:1.0:1787387781.730974:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387781.731007:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709698432:0@lo:400:kworker.0 00000100:00100000:1.0:1787387781.731029:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387781.731047:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709698944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387781.731071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387781.731103:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709698176 00000100:00100000:1.0:1787387781.731108:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709698176 00000100:00100000:1.0:1787387781.731135:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787387781.731141:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709698176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387781.731245:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709698176:12345-0@lo:400:kworker.0 Request processed in 104us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387781.731252:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787387781.731281:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709698688 00000100:00100000:1.0:1787387781.731285:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709698688 00000100:00100000:1.0:1787387781.731310:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709698432 00000100:00100000:1.0:1787387781.731313:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709698432 00000100:00080000:3.0:1787387781.732107:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387781.732114:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787387781.732150:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43746a0000 x1874211709698560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387781.732362:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787387781.732371:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709698688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387781.732561:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387781.732589:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709698816:0@lo:400:kworker.0 00000100:00100000:0.0:1787387781.732616:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387781.733279:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709698560:0@lo:400:kworker.0 00000100:00100000:3.0:1787387781.733434:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709698304 00000100:00100000:3.0:1787387781.733440:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709698304 00000100:00100000:3.0:1787387781.733469:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787387781.733477:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709698432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387781.735248:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709698688:12345-0@lo:400:kworker.0 Request processed in 2870us (4265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387781.735261:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787387781.735290:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787387781.735300:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709698304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387781.735342:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709698304:12345-0@lo:400:kworker.0 Request processed in 45us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387781.735348:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787387781.735410:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709698176:0@lo:400:kworker.0 00000100:00100000:1.0:1787387781.735426:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709698688:0@lo:400:kworker.0 00000100:00100000:1.0:1787387781.735504:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709698816 00000100:00100000:1.0:1787387781.735510:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709698816 00000100:00100000:1.0:1787387781.735571:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787387781.735577:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709698816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387781.735610:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709698816:12345-0@lo:400:kworker.0 Request processed in 34us (2993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387781.735617:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787387781.736078:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709698432:12345-0@lo:400:kworker.0 Request processed in 2599us (5046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387781.736087:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787387781.736122:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709698944 00000100:00100000:3.0:1787387781.736126:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709698944 00000100:00100000:3.0:1787387781.736153:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787387781.736159:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709698944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787387781.736189:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387781.736232:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709698944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (5149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387781.736238:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787387781.736260:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787387781.737249:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709698432:0@lo:400:kworker.0 00010000:00080000:1.0:1787387781.737268:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a086300 x1874211709698944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387781.737286:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709698944:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787387781.737494:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43746a3100 x1874211709698816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387781.737503:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709698816:0@lo:400:kworker.0 00000100:00100000:0.0:1787387781.737523:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709698304:0@lo:400:kworker.0 00010000:00010000:3.0:1787387782.494183:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387782.751851:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709699072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387782.751919:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387782.752020:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709699072 00000100:00100000:2.0:1787387782.752027:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709699072 00000100:00100000:2.0:1787387782.752075:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787387782.752083:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709699072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387782.752130:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387782.752404:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709699072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 321us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387782.752412:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787387782.752476:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43746a0000 x1874211709699072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387782.752495:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709699072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387783.518853:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387783.602906:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387783.602951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387783.602990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387783.603026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387783.603078:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690789248 00000100:00100000:2.0:1787387783.603087:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690789248 00000100:00100000:0.0:1787387783.603112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387783.603141:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690789376 00000100:00100000:2.0:1787387783.603144:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690789376 00000100:00100000:0.0:1787387783.603152:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690789120 00000100:00100000:0.0:1787387783.603154:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690789120 00000100:00100000:2.0:1787387783.603162:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:2.0:1787387783.603170:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2349:x1874211690789248:12345-192.168.204.59@tcp:9:kworker.0 00000100:00100000:0.0:1787387783.603203:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690788992 00000100:00100000:0.0:1787387783.603206:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690788992 00000020:00000080:2.0:1787387783.603214:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c76f3 00000100:00100000:0.0:1787387783.603221:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00080000:2.0:1787387783.603223:0:6605:0:(import.c:65:import_set_state_nolock()) ffff8d437a1ba800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787387783.603227:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690789120:12345-192.168.204.59@tcp:400:kworker.0 00000001:00000004:2.0:1787387783.603255:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787387783.603286:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690789120:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 60us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387783.603293:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:0.0:1787387783.603307:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:0.0:1787387783.603312:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2352:x1874211690788992:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387783.603334:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2352:x1874211690788992:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 22us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387783.603339:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:2.0:1787387783.603558:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+2:2349:x1874211690789248:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 387us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387783.603565:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:2.0:1787387783.603577:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:2.0:1787387783.603583:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2349:x1874211690789376:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:2.0:1787387783.603595:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c76fa 00000100:00080000:2.0:1787387783.603600:0:6605:0:(import.c:65:import_set_state_nolock()) ffff8d437a1be000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787387783.603620:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1787387783.603767:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387783.603776:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787387783.603778:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787387783.603793:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387783.603812:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+2:2349:x1874211690789376:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 228us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387783.603818:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00010000:00010000:2.0:1787387783.603832:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387783.603890:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690788864 00000100:00100000:1.0:1787387783.603895:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690788864 00000100:00100000:1.0:1787387783.603941:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 232 00000100:00100000:1.0:1787387783.603949:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690788864:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387783.603975:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690788864:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387783.603981:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 232 00000001:00100000:2.0:1787387784.344600:0:7514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 130c956a-3dfa-4a85-a4d5-15465fdee9cd 00000020:00000080:2.0:1787387784.344610:0:7514:0:(genops.c:906:class_export_put()) final put ffff8d437a1bc000/130c956a-3dfa-4a85-a4d5-15465fdee9cd 00000020:00000080:3.0:1787387784.344906:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d437a1bc000/130c956a-3dfa-4a85-a4d5-15465fdee9cd for lustre-OST0001 00000020:00000080:3.0:1787387784.344959:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d437a1be000 for lustre-OST0001 00010000:00010000:3.0:1787387784.544432:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387785.565980:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387786.590649:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787387786.730536:0:10890:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787387786.846217:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709699584:0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.846290:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387786.846347:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787387786.846361:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709699200:0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.846391:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387786.846416:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709699712:0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.846439:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387786.846465:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709699328:0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.846486:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387786.846501:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709699840:0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.846519:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387786.846536:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387786.846540:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709699456:0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.846558:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387786.846611:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709699584 00000100:00100000:1.0:1787387786.846618:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709699584 00000100:00100000:1.0:1787387786.846668:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709699840 00000100:00100000:1.0:1787387786.846671:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709699840 00000100:00100000:1.0:1787387786.846689:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787387786.846697:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709699584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.846791:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709699584:12345-0@lo:400:kworker.0 Request processed in 94us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387786.846799:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787387786.846815:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787387786.846821:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709699840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.846851:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709699840:12345-0@lo:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387786.846856:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787387786.846873:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709699712 00000100:00100000:1.0:1787387786.846883:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709699712 00000100:00100000:1.0:1787387786.846909:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709699328 00000100:00100000:1.0:1787387786.846911:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709699328 00000100:00100000:1.0:1787387786.846920:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709699456 00000100:00100000:1.0:1787387786.846923:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709699456 00000100:00100000:1.0:1787387786.846936:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787387786.846941:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709699712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.846970:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709699712:12345-0@lo:400:kworker.0 Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387786.846976:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787387786.846987:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787387786.846993:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709699328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.847017:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709699328:12345-0@lo:400:kworker.0 Request processed in 24us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387786.847036:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787387786.847046:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787387786.847052:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709699456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.847077:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709699456:12345-0@lo:400:kworker.0 Request processed in 26us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387786.847082:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1787387786.847107:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787387786.847112:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387786.847114:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387786.847173:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709699968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387786.847199:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387786.847228:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709699968 00000100:00100000:1.0:1787387786.847231:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709699968 00000100:00100000:1.0:1787387786.847256:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787387786.847268:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709699968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387786.847296:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387786.847329:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709699968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387786.847335:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787387786.847369:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43584e3b80 x1874211709699968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387786.847388:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709699968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387786.847415:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709699456:0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.847423:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709699328:0@lo:400:kworker.0 00010000:00080000:1.0:1787387786.847431:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43584e1f80 x1874211709699840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387786.847439:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709699840:0@lo:400:kworker.0 00000100:00100000:1.0:1787387786.847460:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709699712:0@lo:400:kworker.0 00010000:00080000:1.0:1787387786.847469:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43584e3100 x1874211709699584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387786.847476:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709699584:0@lo:400:kworker.0 00000100:00100000:0.0:1787387786.852703:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709699200 00000100:00100000:0.0:1787387786.852720:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709699200 00000100:00100000:0.0:1787387786.852795:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787387786.852804:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709699200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387786.852897:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709699200:12345-0@lo:400:kworker.0 Request processed in 94us (6505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387786.852904:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787387786.852962:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709699200:0@lo:400:kworker.0 00000001:00100000:1.0:1787387787.435863:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 130c956a-3dfa-4a85-a4d5-15465fdee9cd 00000020:00000080:1.0:1787387787.435872:0:6629:0:(genops.c:906:class_export_put()) final put ffff8d437a1b9800/130c956a-3dfa-4a85-a4d5-15465fdee9cd 00000020:00000080:2.0:1787387787.436027:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d437a1b9800/130c956a-3dfa-4a85-a4d5-15465fdee9cd for lustre-OST0000 00000020:00000080:2.0:1787387787.436091:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d437a1ba800 for lustre-OST0000 00010000:00010000:2.0:1787387787.617573:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387787.870323:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709700096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387787.870398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387787.870529:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709700096 00000100:00100000:2.0:1787387787.870538:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709700096 00000100:00100000:2.0:1787387787.870600:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787387787.870610:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709700096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387787.870645:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387787.870715:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709700096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387787.870723:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787387787.870879:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43746a1180 x1874211709700096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387787.870899:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709700096:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787387788.645591:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387788.715033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387788.715072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387788.715116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387788.715292:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690789632 00000100:00100000:1.0:1787387788.715302:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690789632 00000100:00100000:1.0:1787387788.715353:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690789760 00000100:00100000:1.0:1787387788.715364:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690789760 00000100:00100000:1.0:1787387788.715390:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:1.0:1787387788.715399:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2352:x1874211690789632:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387788.715469:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2352:x1874211690789632:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 71us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387788.715476:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:1.0:1787387788.715492:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:1.0:1787387788.715498:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690789760:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387788.715520:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690789760:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387788.715535:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00080000:1.0:1787387788.715555:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387788.716230:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690789504 00000100:00100000:0.0:1787387788.716238:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690789504 00000100:00100000:0.0:1787387788.716273:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 234 00000100:00100000:0.0:1787387788.716282:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690789504:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387788.716318:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690789504:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 38us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387788.716326:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 234 00010000:00010000:2.0:1787387789.661979:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787387790.481383:0:11040:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffedba22a50 00000020:00000080:2.0:1787387790.481400:0:11040:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787387790.481405:0:11040:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787387790.481414:0:11040:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedba24ce0 20000000:00000080:2.0:1787387790.481421:0:11040:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d437436e800 uarg=0000000000000000 20000000:01000000:2.0:1787387790.481457:0:11040:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787387790.481463:0:11040:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787387790.481468:0:11040:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787387790.482728:0:11041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787387790.482915:0:11040:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787387790.490899:0:11040:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787387790.491427:0:11040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.491449:0:11040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c76a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5277d expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.491458:0:11040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c76b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c76ad expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.491465:0:11040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c76c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c76bb expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.491472:0:11040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d434152fc00/0x93d41aeaa23c76d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c76c9 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.491479:0:11040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d434152f600/0x93d41aeaa23c76e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527b5 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.491486:0:11040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.491532:0:11040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d434152f600/0x93d41aeaa23c76e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527b5 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.491550:0:11040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d434152f600/0x93d41aeaa23c76e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527b5 expref: 12 pid: 5801 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387790.491582:0:11040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11040:1874211709700224:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387790.491699:0:11040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d434152fc00/0x93d41aeaa23c76d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c76c9 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.491706:0:11040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d434152fc00/0x93d41aeaa23c76d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c76c9 expref: 18 pid: 5802 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387790.491715:0:11040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11040:1874211709700352:0@lo:104: 00000100:00100000:3.0:1787387790.491787:0:11040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387790.491827:0:11040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c76c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c76bb expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.491835:0:11040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c76c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c76bb expref: 18 pid: 5802 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387790.491844:0:11040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11040:1874211709700480:0@lo:104: 00000100:00100000:3.0:1787387790.491865:0:11040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387790.491887:0:11040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c76b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c76ad expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.491896:0:11040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c76b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c76ad expref: 18 pid: 5801 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387790.491904:0:11040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11040:1874211709700608:0@lo:104: 00000100:00100000:3.0:1787387790.491922:0:11040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387790.491937:0:11040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c76a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5277d expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387790.492088:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709700352 00000100:00100000:1.0:1787387790.492095:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709700352 00000100:00100000:1.0:1787387790.492143:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709700480 00000100:00100000:1.0:1787387790.492146:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709700480 00000100:00100000:1.0:1787387790.492157:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709700608 00000100:00100000:1.0:1787387790.492159:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709700608 00000100:00100000:1.0:1787387790.492172:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787387790.492180:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:11040:x1874211709700352:12345-0@lo:104: 00010000:00010000:1.0:1787387790.492192:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492241:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787387790.492248:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:11040:x1874211709700352:12345-0@lo:104: Request processed in 69us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387790.492254:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787387790.492278:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787387790.492284:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:11040:x1874211709700480:12345-0@lo:104: 00010000:00010000:1.0:1787387790.492291:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492322:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787387790.492327:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:11040:x1874211709700480:12345-0@lo:104: Request processed in 44us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387790.492332:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787387790.492343:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787387790.492349:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:11040:x1874211709700608:12345-0@lo:104: 00010000:00010000:1.0:1787387790.492355:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492377:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787387790.492381:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:11040:x1874211709700608:12345-0@lo:104: Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387790.492387:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787387790.492404:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787387790.492410:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492417:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e800 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387790.492422:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492430:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387790.492447:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387790.492453:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787387790.492477:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492483:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387790.492501:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492508:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d434152e800/0x93d41aeaa23c76c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c76d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492527:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787387790.492531:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492537:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91a00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387790.492539:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492546:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387790.492552:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387790.492557:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787387790.492576:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492582:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387790.492596:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492603:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c76bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c76c2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492612:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387790.492615:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492621:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152ee00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387790.492624:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492630:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387790.492636:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387790.492641:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787387790.492651:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492657:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387790.492662:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492677:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c76ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c76b4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.492693:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387790.492695:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387790.492697:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387790.492712:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709700864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387790.492766:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387790.492809:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709700992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387790.492831:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387790.492851:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387790.492857:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709701120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387790.492876:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387790.492903:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709700864 00000100:00100000:1.0:1787387790.492907:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709700864 00010000:00010000:1.0:1787387790.492925:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d434152fc00/0x93d41aeaa23c76d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c76c9 expref: 19 pid: 5802 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387790.492944:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709700992 00000100:00100000:1.0:1787387790.492963:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709700992 00010000:00010000:1.0:1787387790.492976:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c76c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c76bb expref: 20 pid: 5802 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387790.492986:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709701120 00000100:00100000:1.0:1787387790.492988:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709701120 00010000:00010000:1.0:1787387790.492997:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c76b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c76ad expref: 21 pid: 5801 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387790.493020:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787387790.493026:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+21:3314:x1874211709700864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787387790.493036:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387790.493041:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d434152fc00/0x93d41aeaa23c76d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c76c9 expref: 21 pid: 5802 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387790.493339:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387790.493348:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+21:3311:x1874211709700992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387790.493356:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387790.493361:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c76c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c76bb expref: 21 pid: 5802 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.493441:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387790.493458:0:5792:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787387790.493467:0:5792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1787387790.493727:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787387790.493735:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+21:3311:x1874211709701120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787387790.493761:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387790.493766:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c76b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c76ad expref: 21 pid: 5801 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387790.493868:0:11040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c76a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5277d expref: 12 pid: 5800 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387790.493880:0:11040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11040:1874211709700736:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387790.493943:0:11040:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4346597840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387790.493965:0:11040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11040:1874211709700352:0@lo:104: 00000100:00100000:3.0:1787387790.493976:0:11040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11040:1874211709700480:0@lo:104: 00000100:00100000:3.0:1787387790.493983:0:11040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11040:1874211709700608:0@lo:104: 00010000:00010000:1.0:1787387790.494552:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d434152fc00/0x93d41aeaa23c76d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c76c9 expref: 21 pid: 5802 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.494572:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152fc00/0x93d41aeaa23c76d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c76c9 expref: 21 pid: 5802 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.494587:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387790.494648:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+20:3314:x1874211709700864:12345-0@lo:103:ldlm_bl.0 Request processed in 1621us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387790.494656:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387790.494778:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709700864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387790.494863:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c76c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c76bb expref: 19 pid: 5802 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387790.494876:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f91e00/0x93d41aeaa23c76c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c76bb expref: 19 pid: 5802 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387790.494885:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387790.494918:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:3311:x1874211709700992:12345-0@lo:103:ldlm_bl.0 Request processed in 1572us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387790.494925:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787387790.495530:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709700992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787387790.495670:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c76b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c76ad expref: 17 pid: 5801 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.495685:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340030a00/0x93d41aeaa23c76b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c76ad expref: 17 pid: 5801 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.495695:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387790.495900:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:3311:x1874211709701120:12345-0@lo:103:ldlm_bl.0 Request processed in 2165us (3022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387790.495908:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787387790.496104:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709701120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387790.503227:0:11040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11040:1874211709700224:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387790.503243:0:11040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11040:1874211709700736:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387790.503278:0:11040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387790.503529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387790.503895:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690789888 00000100:00100000:1.0:1787387790.503903:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690789888 00010000:00010000:1.0:1787387790.503942:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d434152f600/0x93d41aeaa23c76e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527b5 expref: 13 pid: 5801 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387790.503990:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:1.0:1787387790.504000:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690789888:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787387790.504014:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387790.504035:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d434152f600/0x93d41aeaa23c76e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527b5 expref: 13 pid: 5801 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.504057:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d434152f600/0x93d41aeaa23c76e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527b5 expref: 13 pid: 5801 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.504077:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152f600/0x93d41aeaa23c76e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527b5 expref: 13 pid: 5801 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387790.504094:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387790.504824:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:2350:x1874211690789888:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 821us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387790.504834:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:3.0:1787387790.505373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387790.505973:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690790016 00000100:00100000:2.0:1787387790.505982:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690790016 00010000:00010000:2.0:1787387790.506021:0:11042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c76a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5277d expref: 12 pid: 5800 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387790.506062:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:2.0:1787387790.506071:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:2352:x1874211690790016:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387790.506084:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387790.506090:0:11042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c76a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5277d expref: 12 pid: 5800 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506102:0:11042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c76a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5277d expref: 12 pid: 5800 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506689:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c76a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5277d expref: 12 pid: 5800 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506708:0:11042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506716:0:11042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506734:0:11042:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506778:0:11042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506798:0:11042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506803:0:11042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506809:0:11042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387790.506813:0:11042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506821:0:11042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506842:0:11042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387790.506852:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387790.506905:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:2352:x1874211690790016:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 834us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387790.506912:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00010000:00010000:0.0:1787387790.508511:0:11040:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387790.508527:0:11040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387790.508535:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152f400/0x93d41aeaa23c7701 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387790.688940:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387791.710050:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387791.971352:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709701376:0@lo:400:kworker.0 00000100:00100000:3.0:1787387791.971450:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387791.971921:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709701888:0@lo:400:kworker.0 00000100:00100000:3.0:1787387791.971960:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387791.972000:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787387791.972007:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709701248:0@lo:400:kworker.0 00000100:00100000:3.0:1787387791.972049:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387791.972089:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709701760:0@lo:400:kworker.0 00000100:00100000:3.0:1787387791.972116:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387791.972151:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709701248 00000100:00100000:3.0:1787387791.972161:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709701248 00000100:00100000:3.0:1787387791.972221:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787387791.972232:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:3314:x1874211709701248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387791.973483:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709701504:0@lo:400:kworker.0 00000100:00100000:1.0:1787387791.973577:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387791.973617:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709702016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387791.973654:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387791.973689:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387791.974204:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709701632:0@lo:400:kworker.0 00000100:00100000:0.0:1787387791.974223:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709701888 00000100:00100000:0.0:1787387791.974232:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709701888 00000100:00100000:1.0:1787387791.974245:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387791.975057:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:3314:x1874211709701248:12345-0@lo:400:kworker.0 Request processed in 2818us (2998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387791.975072:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787387791.977593:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709701248:0@lo:400:kworker.0 00000100:00100000:0.0:1787387791.978095:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709701632 00000100:00100000:0.0:1787387791.978107:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709701632 00000100:00100000:0.0:1787387791.978186:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787387791.978200:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709701888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387791.980884:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787387791.980909:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787387791.980932:0:6604:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787387791.981073:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787387791.981095:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709701632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387791.988472:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709701888:12345-0@lo:400:kworker.0 Request processed in 10263us (16498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387791.988494:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787387791.988563:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709701376 00000100:00100000:0.0:1787387791.988574:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709701376 00000100:00100000:0.0:1787387791.988629:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709701760 00000100:00100000:0.0:1787387791.988632:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709701760 00000100:00100000:0.0:1787387791.988664:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709701504 00000100:00100000:0.0:1787387791.988668:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709701504 00000100:00100000:0.0:1787387791.988700:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787387791.988709:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709701376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387791.988810:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709701376:12345-0@lo:400:kworker.0 Request processed in 101us (17360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387791.988837:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787387791.988850:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787387791.988855:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787387791.988855:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709701760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387791.988864:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709701504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387791.988887:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709701760:12345-0@lo:400:kworker.0 Request processed in 32us (16771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387791.988893:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787387791.988903:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709701504:12345-0@lo:400:kworker.0 Request processed in 42us (15327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387791.988909:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787387791.988963:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709701504:0@lo:400:kworker.0 00000100:00100000:0.0:1787387791.988966:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709701760:0@lo:400:kworker.0 00000100:00100000:0.0:1787387791.988979:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709701376:0@lo:400:kworker.0 00010000:00080000:0.0:1787387791.988995:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43746a3480 x1874211709701888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387791.989006:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709701888:0@lo:400:kworker.0 00000100:00100000:2.0:1787387791.994408:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709701632:12345-0@lo:400:kworker.0 Request processed in 13307us (20146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387791.994429:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1787387791.994505:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787387791.994514:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387791.994517:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387791.994537:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709702016 00000100:00100000:2.0:1787387791.994549:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709702016 00000100:00100000:2.0:1787387791.994610:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787387791.994619:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709702016:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787387791.994867:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43746a1500 x1874211709701632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387791.994887:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709701632:0@lo:400:kworker.0 00002000:00000024:2.0:1787387791.995061:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387791.995135:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709702016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 517us (21480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387791.995142:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787387791.996654:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a085180 x1874211709702016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387791.996697:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709702016:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1787387792.033777:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787387792.033789:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4377c90800 from 7 10000000:01000000:0.0:1787387792.033796:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387792.033859:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387792.033875:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387792.033895:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387792.033929:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787387792.034417:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387792.034486:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1540 going to sleep for 11 seconds 00000100:00100000:1.0:1787387792.035271:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709702144 00000100:00100000:1.0:1787387792.035294:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709702144 00000100:00100000:1.0:1787387792.035368:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787387792.035380:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709702144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387792.035400:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387792.035426:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4342ad4c00/0x93d41aeaa23c770f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7708 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387792.035459:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad4c00/0x93d41aeaa23c770f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7708 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387792.035471:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4342ad4c00/0x93d41aeaa23c770f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7708 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387792.035482:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4c00, rc 0) 00000100:00100000:1.0:1787387792.035553:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709702144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387792.035560:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787387792.036046:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387792.036071:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387792.036082:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387792.036172:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387792.036223:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387792.036307:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1540 going to sleep for 11 seconds 00000100:00100000:3.0:1787387792.036612:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709702272 00000100:00100000:3.0:1787387792.036621:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709702272 00000100:00100000:3.0:1787387792.036672:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787387792.036681:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709702272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387792.037676:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709702272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 991us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387792.037688:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787387792.038243:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387792.038314:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387792.038379:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387792.038424:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1540 going to sleep for 11 seconds 00000100:00100000:3.0:1787387792.038681:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709702400 00000100:00100000:3.0:1787387792.038689:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709702400 00000100:00100000:3.0:1787387792.038731:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787387792.038811:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709702400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387792.039397:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709702400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 656us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387792.039408:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787387792.039502:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787387792.040448:0:11072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787387792.043949:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787387792.043995:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387792.044011:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387792.044037:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387792.044052:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787387792.044056:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4379110800 from 7 10000000:01000000:2.0:1787387792.044059:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387792.044113:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387792.044122:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387792.044137:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387792.044183:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387792.044277:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387792.044338:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350d12240 going to sleep for 11 seconds 00000100:00100000:0.0:1787387792.044483:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709702528 00000100:00100000:0.0:1787387792.044493:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709702528 00000100:00100000:0.0:1787387792.044560:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787387792.044572:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709702528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387792.044589:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387792.044612:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43821ce400/0x93d41aeaa23c771d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7716 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387792.044642:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43821ce400/0x93d41aeaa23c771d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7716 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387792.044654:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43821ce400/0x93d41aeaa23c771d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7716 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387792.044665:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43821ce400, rc 0) 00000100:00100000:0.0:1787387792.044708:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709702528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387792.044727:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787387792.044922:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387792.044939:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387792.044948:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387792.045012:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387792.045066:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387792.045096:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350d12240 going to sleep for 11 seconds 00000100:00100000:0.0:1787387792.045184:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709702656 00000100:00100000:0.0:1787387792.045190:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709702656 00000100:00100000:0.0:1787387792.045221:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787387792.045228:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709702656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387792.045552:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709702656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387792.045561:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787387792.045593:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387792.045629:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387792.045674:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387792.045697:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709702784 00000100:00100000:0.0:1787387792.045701:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709702784 00000100:00100000:0.0:1787387792.045769:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787387792.045777:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709702784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387792.046110:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709702784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 332us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387792.046118:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787387792.046157:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387792.046170:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787387792.047418:0:11073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787387792.047725:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787387792.047783:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787387792.047808:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387792.047822:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387792.047835:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787387792.047838:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4350ce4000 from 7 10000000:01000000:3.0:1787387792.047841:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787387792.047897:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387792.047905:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387792.047917:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387792.047946:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787387792.048031:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387792.048077:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4346597f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787387792.049191:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709702912 00000100:00100000:0.0:1787387792.049209:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709702912 00000100:00100000:0.0:1787387792.049290:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787387792.049303:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709702912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387792.049323:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387792.049347:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43821cf400/0x93d41aeaa23c772b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7724 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387792.049378:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43821cf400/0x93d41aeaa23c772b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7724 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387792.049390:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43821cf400/0x93d41aeaa23c772b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7724 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387792.049400:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43821cf400, rc 0) 00000100:00100000:0.0:1787387792.049486:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709702912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387792.049493:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787387792.050132:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709702912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387792.050158:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387792.050172:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387792.050276:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709703040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387792.050360:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387792.050403:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4346597f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387792.054128:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709703040 00000100:00100000:2.0:1787387792.054151:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709703040 00000100:00100000:2.0:1787387792.054251:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787387792.054264:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709703040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387792.054685:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709703040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 423us (4322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387792.054693:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787387792.055058:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709703040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387792.055134:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709703168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387792.055196:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387792.055247:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4346597f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387792.055407:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709703168 00000100:00100000:2.0:1787387792.055413:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709703168 00000100:00100000:2.0:1787387792.055452:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787387792.055459:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709703168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387792.055631:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709703168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387792.055643:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787387792.056263:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709703168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787387792.057312:0:11074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787387792.057576:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787387792.057606:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387792.057619:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387792.057633:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387792.492216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387792.492389:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690790144 00000100:00100000:1.0:1787387792.492400:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690790144 00000100:00100000:1.0:1787387792.492460:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 245 00000100:00100000:1.0:1787387792.492470:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:5569:x1874211690790144:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387792.492486:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387792.492504:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4342ad5c00/0x93d41aeaa23c7732 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b527df expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387792.492543:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad5c00/0x93d41aeaa23c7732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527df expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387792.492570:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4342ad5c00/0x93d41aeaa23c7732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527df expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387792.492578:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5c00, rc 0) 00000100:00100000:1.0:1787387792.492635:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690790144:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 166us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387792.492641:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 245 00000100:00100000:1.0:1787387792.508308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387792.508396:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690790272 00000100:00100000:0.0:1787387792.508407:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690790272 00000100:00100000:0.0:1787387792.508475:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 246 00000100:00100000:0.0:1787387792.508485:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690790272:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387792.516481:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690790272:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 7986us (8571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387792.516495:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 246 00000100:00100000:1.0:1787387792.545048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387792.545308:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690790400 00000100:00100000:0.0:1787387792.545319:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690790400 00000100:00100000:0.0:1787387792.545370:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 247 00000100:00100000:0.0:1787387792.545380:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690790400:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387792.545629:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690790400:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 249us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387792.545637:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 247 00000100:00100000:0.0:1787387792.568661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387792.575258:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690790528 00000100:00100000:3.0:1787387792.575272:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690790528 00000100:00100000:1.0:1787387792.587077:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 248 00000100:00100000:1.0:1787387792.587100:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690790528:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387792.587118:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387792.587137:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4342ad5000/0x93d41aeaa23c7739 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b527e6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387792.587180:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad5000/0x93d41aeaa23c7739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527e6 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387792.587193:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4342ad5000/0x93d41aeaa23c7739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527e6 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387792.587202:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5000, rc 0) 00000100:00100000:1.0:1787387792.587275:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:5569:x1874211690790528:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 173us (19533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387792.587286:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 248 00000100:00100000:1.0:1787387792.603426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387792.603630:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690790656 00000100:00100000:3.0:1787387792.603642:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690790656 00000100:00100000:3.0:1787387792.603697:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 249 00000100:00100000:3.0:1787387792.603708:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:5569:x1874211690790656:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387792.604671:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:5569:x1874211690790656:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 961us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387792.604681:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 249 00000100:00100000:1.0:1787387792.623217:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387792.623419:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690790784 00000100:00100000:0.0:1787387792.623430:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690790784 00000100:00100000:0.0:1787387792.623484:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 250 00000100:00100000:0.0:1787387792.623493:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:5569:x1874211690790784:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387792.623705:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:5569:x1874211690790784:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 213us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387792.623713:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 250 00010000:00010000:0.0:1787387792.734205:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387792.990253:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709703296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387792.990328:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387792.996123:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709703296 00000100:00100000:2.0:1787387792.996137:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709703296 00000100:00100000:2.0:1787387792.996198:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787387792.996208:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709703296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387792.996248:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387792.996339:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709703296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (6010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387792.996345:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787387792.996396:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43746a1500 x1874211709703296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387792.996418:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709703296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787387793.757910:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387793.835263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387793.835377:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690790912 00000100:00100000:2.0:1787387793.835389:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690790912 00000100:00100000:2.0:1787387793.835448:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 251 00000100:00100000:2.0:1787387793.835459:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690790912:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387793.835543:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690790912:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 86us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387793.835567:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 251 00000100:00100000:3.0:1787387793.841476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387793.841700:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690791040 00000100:00100000:0.0:1787387793.841711:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690791040 00000100:00100000:0.0:1787387793.841800:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:0.0:1787387793.841811:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690791040:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387793.841884:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690791040:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 74us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387793.841906:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00080000:3.0:1787387793.841993:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387793.848602:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387793.851693:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690791168 00000100:00100000:3.0:1787387793.851707:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690791168 00000100:00100000:3.0:1787387793.851816:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:3.0:1787387793.851835:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2351:x1874211690791168:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:1.0:1787387793.851849:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387793.851929:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2351:x1874211690791168:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 96us (3337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387793.851938:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 105 00010000:00010000:0.0:1787387794.781835:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787387794.940222:0:11240:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787387795.807149:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387796.833912:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387797.087263:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709703552:0@lo:400:kworker.0 00000100:00100000:2.0:1787387797.087338:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387797.087384:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709704064:0@lo:400:kworker.0 00000100:00100000:2.0:1787387797.087410:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387797.087439:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787387797.087445:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709703424:0@lo:400:kworker.0 00000100:00100000:2.0:1787387797.087482:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387797.087513:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709703936:0@lo:400:kworker.0 00000100:00100000:2.0:1787387797.087532:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387797.087569:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709703680:0@lo:400:kworker.0 00000100:00100000:2.0:1787387797.087592:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387797.087609:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387797.087614:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709703808:0@lo:400:kworker.0 00000100:00100000:0.0:1787387797.087757:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709703552 00000100:00100000:0.0:1787387797.087766:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709703552 00000100:00100000:0.0:1787387797.087810:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709703936 00000100:00100000:0.0:1787387797.087813:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709703936 00000100:00100000:0.0:1787387797.087836:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709703680 00000100:00100000:0.0:1787387797.087839:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709703680 00000100:00100000:0.0:1787387797.087867:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787387797.087876:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709703552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387797.087941:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709703552:12345-0@lo:400:kworker.0 Request processed in 67us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387797.087948:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787387797.087966:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787387797.087971:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709703936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387797.088011:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709703936:12345-0@lo:400:kworker.0 Request processed in 39us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387797.088016:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787387797.088027:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787387797.088033:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709703680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387797.088058:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709703680:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387797.088065:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787387797.088084:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709704064 00000100:00100000:0.0:1787387797.088087:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709704064 00000100:00100000:0.0:1787387797.088480:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787387797.088508:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709704064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387797.088542:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709704064:12345-0@lo:400:kworker.0 Request processed in 36us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387797.088548:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787387797.088578:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709703424 00000100:00100000:0.0:1787387797.088582:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709703424 00000100:00100000:0.0:1787387797.088606:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787387797.088612:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709703424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387797.088650:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709703424:12345-0@lo:400:kworker.0 Request processed in 38us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387797.088657:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:0.0:1787387797.088717:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787387797.088722:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387797.088776:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709703424:0@lo:400:kworker.0 00000100:00100000:0.0:1787387797.088790:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709703936:0@lo:400:kworker.0 00000100:00100000:0.0:1787387797.088799:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709703552:0@lo:400:kworker.0 00010000:00080000:0.0:1787387797.088810:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a087b80 x1874211709704064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387797.088820:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709704064:0@lo:400:kworker.0 00000100:00100000:3.0:1787387797.089796:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387797.089818:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709704192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387797.089868:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387797.090197:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387797.090246:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709703680:0@lo:400:kworker.0 00000100:00100000:1.0:1787387797.090604:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709704192 00000100:00100000:1.0:1787387797.090611:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709704192 00000100:00100000:1.0:1787387797.090665:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787387797.090673:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709704192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387797.090713:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387797.090783:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709704192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387797.090790:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787387797.090825:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345014380 x1874211709704192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387797.090841:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709704192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387797.092152:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709703808 00000100:00100000:3.0:1787387797.092164:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709703808 00000100:00100000:3.0:1787387797.092226:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787387797.092237:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709703808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387797.092312:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709703808:12345-0@lo:400:kworker.0 Request processed in 77us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387797.092320:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1787387797.092364:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a087100 x1874211709703808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387797.092378:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709703808:0@lo:400:kworker.0 00000100:00080000:0.0:1787387797.095431:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787387797.857773:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387798.113305:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387798.113330:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709704320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387798.113404:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387798.113610:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709704320 00000100:00100000:3.0:1787387798.113619:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709704320 00000100:00100000:3.0:1787387798.113665:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787387798.113675:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709704320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787387798.113711:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387798.113786:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709704320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387798.113810:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787387798.113893:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43746a2680 x1874211709704320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387798.113922:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709704320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387798.880867:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387798.952959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387798.953010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387798.953040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387798.953068:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690791296 00000100:00100000:1.0:1787387798.953078:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690791296 00000100:00100000:3.0:1787387798.953106:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690791424 00000100:00100000:3.0:1787387798.953113:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690791424 00000100:00100000:1.0:1787387798.953135:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 253 00000100:00100000:1.0:1787387798.953149:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434657a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690791296:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387798.953157:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690791552 00000100:00100000:3.0:1787387798.953160:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690791552 00000100:00100000:3.0:1787387798.953185:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:3.0:1787387798.953193:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690791424:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387798.953224:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434657a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690791296:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387798.953232:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690791424:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 38us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387798.953237:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 253 00000100:00100000:3.0:1787387798.953243:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:3.0:1787387798.953263:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:3.0:1787387798.953271:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690791552:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387798.953293:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690791552:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387798.953299:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00080000:3.0:1787387798.953316:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787387799.270311:0:11340:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:36:37 (1787387797) === 00000100:00100000:1.0:1787387799.714391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387799.714517:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387799.715100:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690791808 00000100:00100000:2.0:1787387799.715117:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690791808 00000100:00100000:2.0:1787387799.715194:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:2.0:1787387799.715207:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:9664:x1874211690791808:12345-192.168.204.59@tcp:700:mkdir.0 00000100:00100000:2.0:1787387799.715374:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:9664:x1874211690791808:12345-192.168.204.59@tcp:700:mkdir.0 Request processed in 169us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387799.715383:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1787387799.715805:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690791680 00000100:00100000:3.0:1787387799.715821:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690791680 00000100:00100000:3.0:1787387799.715865:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1787387799.715883:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690791680:12345-192.168.204.59@tcp:41:mkdir.0 00000004:00000024:3.0:1787387799.715926:0:5808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787387799.716003:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690791680:12345-192.168.204.59@tcp:41:mkdir.0 Request processed in 122us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387799.716011:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:1.0:1787387799.742606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387799.743472:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690792064 00000100:00100000:3.0:1787387799.743514:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690792064 00000100:00100000:3.0:1787387799.743596:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:3.0:1787387799.743611:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:9664:x1874211690792064:12345-192.168.204.59@tcp:36:mkdir.0 00010000:00010000:3.0:1787387799.743696:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387799.743960:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7621 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52768 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.743992:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720500) 00010000:00010000:3.0:1787387799.744028:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387799.744388:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7740 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.744402:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7740 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.744411:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7740 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.744440:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7747 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.744448:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7747 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.744455:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7747 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387799.745912:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787387799.745932:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7740 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.745941:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7740 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.745956:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7740 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.745964:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152ea00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387799.745969:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7740 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.745977:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7740 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.745995:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:3.0:1787387799.745999:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387799.746004:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7740 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.746012:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7740 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787387799.746033:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070c61baf reply state 000000001b848ea8 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7747 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387799.746042:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787387799.746151:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:9664:x1874211690792064:12345-192.168.204.59@tcp:36:mkdir.0 Request processed in 2540us (3557us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787387799.746160:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00010000:00010000:3.0:1787387799.751047:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7747 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.751066:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7747 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.751105:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7747 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.751111:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387799.751116:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7747 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.751124:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7747 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.751140:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d4343c2d200) 00010000:00010000:3.0:1787387799.751144:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387799.751148:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7747 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.751154:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7747 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387799.797969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387799.798188:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690792192 00000100:00100000:3.0:1787387799.798200:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690792192 00000100:00100000:3.0:1787387799.798265:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:3.0:1787387799.798275:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:9668:x1874211690792192:12345-192.168.204.59@tcp:101:chmod.0 00010000:00010000:3.0:1787387799.798298:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387799.798326:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c774e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b527ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.798403:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7755 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.798439:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.798451:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387799.798516:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787387799.798520:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387799.798560:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.798587:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c774e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527ed expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.798605:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527ed expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.798614:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d200) 00010000:00010000:3.0:1787387799.798617:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387799.798621:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152ea00, rc 0) 00000100:00100000:3.0:1787387799.798693:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:9668:x1874211690792192:12345-192.168.204.59@tcp:101:chmod.0 Request processed in 420us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387799.798701:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:1.0:1787387799.803244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387799.803349:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690792448 00000100:00100000:0.0:1787387799.803360:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690792448 00000100:00100000:0.0:1787387799.803416:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:0.0:1787387799.803426:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:9668:x1874211690792448:12345-192.168.204.59@tcp:36:chmod.0 00010000:00010000:0.0:1787387799.803495:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387799.803524:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c7755 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527ed expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387799.803544:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d200) 00010000:00010000:0.0:1787387799.803555:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387799.803582:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c775c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387799.803594:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c775c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387799.803603:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c775c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787387799.804356:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ed138ae reply state 00000000ad70541d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c775c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387799.804369:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787387799.804385:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787387799.804529:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:9668:x1874211690792448:12345-192.168.204.59@tcp:36:chmod.0 Request processed in 1103us (1293us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787387799.804538:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00010000:00010000:3.0:1787387799.820606:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c775c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.820629:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c775c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.820651:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c775c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.820657:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43821cfc00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387799.820662:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c775c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.820670:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c775c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.820693:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c46400) 00010000:00010000:3.0:1787387799.820697:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787387799.820702:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c775c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.820708:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c775c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387799.865520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387799.865711:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690792576 00000100:00100000:3.0:1787387799.865733:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690792576 00000100:00100000:3.0:1787387799.865873:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:3.0:1787387799.865886:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:9669:x1874211690792576:12345-192.168.204.59@tcp:101:chown.0 00010000:00010000:3.0:1787387799.865926:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387799.865963:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b527f4 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.866064:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c776a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.866081:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c776a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.866110:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c776a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387799.866220:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787387799.866225:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387799.866280:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c776a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.866316:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527f4 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.866341:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c776a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527f4 expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387799.866352:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:3.0:1787387799.866355:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387799.866361:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152ea00, rc 0) 00000100:00100000:3.0:1787387799.866447:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:9669:x1874211690792576:12345-192.168.204.59@tcp:101:chown.0 Request processed in 563us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387799.866456:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1787387799.872075:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387799.872269:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690792704 00000100:00100000:3.0:1787387799.872297:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690792704 00000100:00100000:2.0:1787387799.872448:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:2.0:1787387799.872466:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:9669:x1874211690792704:12345-192.168.204.59@tcp:101:chown.0 00010000:00010000:2.0:1787387799.872491:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387799.872517:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7771 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b527fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872600:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90a00/0x93d41aeaa23c7778 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872615:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90a00/0x93d41aeaa23c7778 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872627:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90a00/0x93d41aeaa23c7778 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872640:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c777f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872646:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c777f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872652:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c777f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872807:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7786 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872816:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872823:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387799.872882:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787387799.872887:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787387799.872918:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872933:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90a00/0x93d41aeaa23c7778 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872941:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90a00/0x93d41aeaa23c7778 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872948:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90a00/0x93d41aeaa23c7778 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872956:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387799.872961:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90a00/0x93d41aeaa23c7778 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872969:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90a00/0x93d41aeaa23c7778 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.872983:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:2.0:1787387799.872993:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387799.872999:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90a00/0x93d41aeaa23c7778 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.873005:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90a00/0x93d41aeaa23c7778 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.873021:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c777f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.873027:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c777f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.873032:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c777f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.873038:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387799.873040:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c777f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.873046:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c777f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.873054:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d436f2f6c00) 00010000:00010000:2.0:1787387799.873056:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387799.873059:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c777f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.873065:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c777f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.873273:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7771 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527fb expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.873301:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527fb expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.873309:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d436f2f6900) 00010000:00010000:2.0:1787387799.873311:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787387799.873314:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91000, rc 0) 00000100:00100000:2.0:1787387799.873377:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:9669:x1874211690792704:12345-192.168.204.59@tcp:101:chown.0 Request processed in 916us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387799.873385:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1787387799.880074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387799.880213:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690792960 00000100:00100000:2.0:1787387799.880223:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690792960 00000100:00100000:2.0:1787387799.880282:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:2.0:1787387799.880291:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:9669:x1874211690792960:12345-192.168.204.59@tcp:36:chown.0 00010000:00010000:2.0:1787387799.880343:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387799.880369:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7786 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527fb expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.880385:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d436f2f6900) 00010000:00010000:2.0:1787387799.880397:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787387799.880423:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c778d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.880434:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c778d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.880445:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c778d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387799.907673:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1787387799.936244:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007347d326 reply state 00000000f9e39f74 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c778d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387799.936273:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787387799.936426:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1787387799.936447:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00200000:2.0:1787387799.936608:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787387799.936788:0:5809:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787387799.936817:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:9669:x1874211690792960:12345-192.168.204.59@tcp:36:chown.0 Request processed in 56518us (56746us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787387799.936830:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00010000:00010000:0.0:1787387799.936917:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c778d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387799.936931:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c778d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387799.936939:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c778d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387799.936957:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387799.936961:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c778d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387799.936969:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c778d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387799.936986:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d436f2f6c00) 00010000:00010000:0.0:1787387799.936989:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787387799.936993:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c778d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387799.936999:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c778d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387799.994352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387799.994514:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690793088 00000100:00100000:0.0:1787387799.994525:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690793088 00000100:00100000:0.0:1787387799.994583:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:0.0:1787387799.994593:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:9670:x1874211690793088:12345-192.168.204.59@tcp:101:touch.500 00010000:00010000:0.0:1787387799.994618:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387799.994638:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7794 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52802 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787387799.996258:0:6840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1561us 00010000:00010000:0.0:1787387800.031681:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c779b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.031702:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c779b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.031723:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c779b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.031763:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c77a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.031771:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c77a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.031778:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c77a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032218:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c77a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032229:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c77a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032236:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c77a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387800.032318:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787387800.032322:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387800.032418:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c77a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032432:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c779b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032439:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c779b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032454:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c779b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032461:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43821cee00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387800.032465:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c779b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032473:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c779b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032485:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:0.0:1787387800.032489:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387800.032494:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c779b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032500:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c779b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032511:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c77a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032517:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c77a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032523:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c77a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032529:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43821cf200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387800.032532:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c77a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032547:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c77a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032555:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d4343c46300) 00010000:00010000:0.0:1787387800.032558:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387800.032561:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c77a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032567:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c77a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032605:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7794 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52802 expref: 8 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032618:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c77a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52802 expref: 7 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.032626:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d4343c46d00) 00010000:00010000:0.0:1787387800.032629:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787387800.032631:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43821cfc00, rc 0) 00000100:00100000:0.0:1787387800.032701:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:9670:x1874211690793088:12345-192.168.204.59@tcp:101:touch.500 Request processed in 38109us (38358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387800.032711:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:1.0:1787387800.043231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387800.043558:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690793344 00000100:00100000:3.0:1787387800.043568:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690793344 00000100:00100000:3.0:1787387800.043683:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1787387800.043695:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:9670:x1874211690793344:12345-192.168.204.59@tcp:101:touch.500 00010000:00010000:3.0:1787387800.043716:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387800.043779:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c77b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52809 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.044139:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c77b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.044154:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c77b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.044165:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c77b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.044243:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c77be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.044251:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c77be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.044258:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c77be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787387800.045088:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787387800.045355:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c77c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.045368:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c77c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.045377:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c77c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.045412:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c77b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.045430:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c77b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.045438:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c77b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.045444:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387800.045449:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c77b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.045457:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c77b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.045470:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d4343c46d00) 00010000:00010000:3.0:1787387800.045473:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387800.045478:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c77b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.045485:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c77b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787387800.045499:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da52c34d reply state 0000000058ea1de8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c77be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387800.045510:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787387800.045543:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c77b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52809 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.045558:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c77c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52809 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.045578:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387800.045581:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387800.045583:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f600, rc 0) 00000100:00100000:3.0:1787387800.045649:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:9670:x1874211690793344:12345-192.168.204.59@tcp:101:touch.500 Request processed in 1958us (2428us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787387800.045658:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00080000:0.0:1787387800.046007:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387800.053445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:0.0:1787387800.058640:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c77be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.058659:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c77be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.058684:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c77be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.058690:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387800.058695:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c77be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.058708:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c77be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.058728:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff8d4343c2d500) 00010000:00010000:0.0:1787387800.058731:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387800.058735:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c77be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.058773:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c77be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387800.059987:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690793600 00000100:00100000:2.0:1787387800.060000:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690793600 00000100:00100000:3.0:1787387800.060179:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:3.0:1787387800.060190:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:9670:x1874211690793600:12345-192.168.204.59@tcp:36:touch.500 00010000:00010000:3.0:1787387800.060252:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387800.060277:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c77c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52809 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.060293:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387800.060304:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387800.060349:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.060362:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.060372:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787387800.060494:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de6f7de0 reply state 00000000ecf4ef54 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387800.060519:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787387800.060618:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:9670:x1874211690793600:12345-192.168.204.59@tcp:36:touch.500 Request processed in 429us (7187us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787387800.060626:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00010000:00010000:3.0:1787387800.063204:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.063224:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.063233:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.063241:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152fc00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387800.063247:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.063256:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.063274:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d4343c2d100) 00010000:00010000:3.0:1787387800.063277:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387800.063282:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.063289:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387800.066131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387800.066578:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690793728 00000100:00100000:2.0:1787387800.066590:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690793728 00000100:00100000:2.0:1787387800.066650:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:2.0:1787387800.066661:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:9670:x1874211690793728:12345-192.168.204.59@tcp:101:touch.500 00010000:00010000:2.0:1787387800.066689:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387800.066715:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c77da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52810 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.066827:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c77da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52810 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.066842:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c77da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52810 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.066871:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d436f2f6900) 00010000:00010000:2.0:1787387800.066889:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387800.066893:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91000, rc 0) 00000100:00100000:2.0:1787387800.066953:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:9670:x1874211690793728:12345-192.168.204.59@tcp:101:touch.500 Request processed in 294us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387800.066960:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:1.0:1787387800.071997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387800.072097:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690793856 00000100:00100000:0.0:1787387800.072108:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690793856 00000100:00100000:0.0:1787387800.072155:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1787387800.072163:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874211690793856:12345-192.168.204.59@tcp:8:touch.500 00010000:00080000:0.0:1787387800.072194:0:6606:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:0.0:1787387800.072226:0:6606:0:(genops.c:1406:class_connect()) connect: client d7138a1c-1444-4499-9235-7f89dd5ceb0b, cookie 0x93d41aeaa23c77e1 00002000:00100000:0.0:1787387800.072238:0:6606:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d7138a1c-1444-4499-9235-7f89dd5ceb0b/ffff8d437aabc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787387800.072262:0:6606:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:0.0:1787387800.072490:0:6606:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787387800.072531:0:6606:0:(import.c:65:import_set_state_nolock()) ffff8d437aabd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387800.072645:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2349:x1874211690793856:12345-192.168.204.59@tcp:8:touch.500 Request processed in 481us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387800.072654:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:1.0:1787387800.079618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387800.079718:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690793984 00000100:00100000:3.0:1787387800.079768:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690793984 00000100:00100000:3.0:1787387800.079831:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:3.0:1787387800.079842:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:0:x1874211690793984:12345-192.168.204.59@tcp:2:touch.500 00000100:00080000:0.0:1787387800.080154:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1787387800.132133:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000001:00080000:1.0:1787387800.132155:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1787387800.132339:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:0:x1874211690793984:12345-192.168.204.59@tcp:2:touch.500 Request processed in 52492us (52724us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787387800.132350:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:1.0:1787387800.134794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387800.134978:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690794240 00000100:00100000:0.0:1787387800.134989:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690794240 00000100:00100000:0.0:1787387800.135051:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:0.0:1787387800.135061:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:9670:x1874211690794240:12345-192.168.204.59@tcp:35:touch.500 00000100:00100000:0.0:1787387800.135404:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:9670:x1874211690794240:12345-192.168.204.59@tcp:35:touch.500 Request processed in 343us (663us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787387800.135412:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:1.0:1787387800.147095:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387800.147188:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690794368 00000100:00100000:3.0:1787387800.147199:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690794368 00000100:00100000:3.0:1787387800.147260:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:3.0:1787387800.147278:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:9671:x1874211690794368:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:3.0:1787387800.147314:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387800.147337:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52817 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.147417:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c77ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.148093:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c77ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.148107:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c77ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387800.148221:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787387800.148226:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387800.148366:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c77ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.148496:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c77e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52817 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.148516:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c77ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52817 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.148545:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d4343c46d00) 00010000:00010000:3.0:1787387800.148548:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387800.148553:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f600, rc 0) 00000100:00100000:3.0:1787387800.148683:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+12:9671:x1874211690794368:12345-192.168.204.59@tcp:101:rm.0 Request processed in 1406us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387800.148691:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:3.0:1787387800.154400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387800.154569:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690794624 00000100:00100000:2.0:1787387800.154580:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690794624 00000100:00100000:2.0:1787387800.154641:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:2.0:1787387800.154651:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+12:9671:x1874211690794624:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:2.0:1787387800.154672:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387800.154692:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c77f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5281e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387800.154849:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787387800.155015:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c77f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5281e expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.155031:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:2.0:1787387800.155034:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787387800.155040:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c77f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5281e expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.155053:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90c00, rc 0) 00000100:00100000:2.0:1787387800.155127:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:9671:x1874211690794624:12345-192.168.204.59@tcp:101:rm.0 Request processed in 476us (745us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787387800.155135:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:1.0:1787387800.162599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387800.162883:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690794752 00000100:00100000:0.0:1787387800.162895:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690794752 00000100:00100000:0.0:1787387800.162943:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:0.0:1787387800.162952:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:9671:x1874211690794752:12345-192.168.204.59@tcp:37:rm.0 00000100:00100000:0.0:1787387800.173252:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:9671:x1874211690794752:12345-192.168.204.59@tcp:37:rm.0 Request processed in 10290us (10652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387800.173266:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:3.0:1787387800.178989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387800.179142:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690795008 00000100:00100000:1.0:1787387800.179153:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690795008 00000100:00100000:1.0:1787387800.179214:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1787387800.179224:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d436567c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:9671:x1874211690795008:12345-192.168.204.59@tcp:35:rm.0 00000100:00100000:1.0:1787387800.180574:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d436567c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:9671:x1874211690795008:12345-192.168.204.59@tcp:35:rm.0 Request processed in 1345us (1587us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787387800.180586:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:0.0:1787387800.192062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387800.192151:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690795264 00000100:00100000:3.0:1787387800.192161:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690795264 00000100:00100000:3.0:1787387800.192251:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:3.0:1787387800.192262:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:9671:x1874211690795264:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:3.0:1787387800.192295:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387800.192322:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52825 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.192610:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c780b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.192626:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c780b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.192637:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c780b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387800.192648:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787387800.192831:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52825 expref: 17 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.192876:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c780b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52825 expref: 16 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.192886:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d4343c46d00) 00010000:00010000:3.0:1787387800.192889:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787387800.192893:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e000, rc 0) 00000100:00100000:3.0:1787387800.192946:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:9671:x1874211690795264:12345-192.168.204.59@tcp:101:rm.0 Request processed in 686us (892us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787387800.192953:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:0.0:1787387800.199785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387800.199972:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690795392 00000100:00100000:3.0:1787387800.199982:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690795392 00000100:00100000:3.0:1787387800.200037:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:3.0:1787387800.200047:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:9671:x1874211690795392:12345-192.168.204.59@tcp:41:rm.0 00000004:00000024:3.0:1787387800.200108:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787387800.200173:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:9671:x1874211690795392:12345-192.168.204.59@tcp:41:rm.0 Request processed in 126us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387800.200180:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:1.0:1787387800.206149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387800.206261:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690795520 00000100:00100000:0.0:1787387800.206278:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690795520 00000100:00100000:0.0:1787387800.206399:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:0.0:1787387800.206411:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:9671:x1874211690795520:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:0.0:1787387800.206435:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387800.206455:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c7819 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5282c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207150:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c7820 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207166:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c7820 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207189:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c7820 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207207:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7827 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207214:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207220:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207512:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c782e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207522:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207530:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387800.207571:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787387800.207575:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387800.207597:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207609:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207618:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c7820 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207625:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c7820 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207632:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c7820 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207637:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43821cf200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387800.207642:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c7820 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207649:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c7820 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207661:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d4343c46d00) 00010000:00010000:0.0:1787387800.207664:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387800.207668:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c7820 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207674:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cf200/0x93d41aeaa23c7820 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207697:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207704:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7827 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207711:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7827 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207716:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43821ce200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387800.207719:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7827 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207725:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7827 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207733:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff8d4343c46a00) 00010000:00010000:0.0:1787387800.207736:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387800.207774:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7827 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.207781:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821ce200/0x93d41aeaa23c7827 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.208173:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cee00/0x93d41aeaa23c7819 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5282c expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.208192:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c782e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5282c expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.208210:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d436f2f6900) 00010000:00010000:0.0:1787387800.208213:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387800.208216:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70a00, rc 0) 00000100:00100000:0.0:1787387800.208526:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:9671:x1874211690795520:12345-192.168.204.59@tcp:101:rm.0 Request processed in 2116us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387800.208535:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:0.0:1787387800.214074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387800.214158:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690795776 00000100:00100000:3.0:1787387800.214167:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690795776 00000100:00100000:3.0:1787387800.214260:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:3.0:1787387800.214278:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:9671:x1874211690795776:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:3.0:1787387800.214337:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787387800.214362:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c782e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5282c expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.214408:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c77da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52810 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.214419:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d436f2f6900) 00010000:00010000:3.0:1787387800.214434:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c77ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52817 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.214443:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d4343c46d00) 00010000:00010000:3.0:1787387800.214447:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387800.214467:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7835 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.214479:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7835 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.214488:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7835 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.214504:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c783c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.214512:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c783c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.214519:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c783c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.214623:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7843 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.214647:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7843 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.214654:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7843 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787387800.216671:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787387800.216696:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 304665956446ns, next at 305665953756ns, rc = 0 00010000:00010000:2.0:1787387800.216830:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c784a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216846:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c784a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216865:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c784a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216874:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c784a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216880:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c784a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216886:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c784a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216904:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387800.216925:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7843 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216932:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7843 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216937:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7843 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216944:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152ee00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387800.216948:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7843 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216966:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7843 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216979:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:2.0:1787387800.216982:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787387800.216986:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7843 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.216993:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7843 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.217012:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7835 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.217018:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7835 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.217023:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7835 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.217028:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152fc00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387800.217030:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7835 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.217035:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7835 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.217042:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d4343c46d00) 00010000:00010000:2.0:1787387800.217044:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387800.217047:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7835 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.217062:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7835 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787387800.217073:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c5d51b4 reply state 000000003d6adfed transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c783c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387800.217082:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787387800.217168:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:9671:x1874211690795776:12345-192.168.204.59@tcp:36:rm.0 Request processed in 2888us (3101us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787387800.217177:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00010000:00010000:0.0:1787387800.217769:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387800.217777:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c784a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.217785:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90c00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387800.217788:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c784a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.217795:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c784a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.217814:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:0.0:1787387800.217818:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787387800.217821:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c784a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.217825:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c784a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.217844:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387800.217845:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387800.217847:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387800.219169:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c783c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.219183:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c783c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.219190:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c783c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.219195:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387800.219199:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c783c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.219205:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c783c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.219219:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff8d4343c2d100) 00010000:00010000:0.0:1787387800.219222:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387800.219226:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c783c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387800.219232:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c783c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387800.220464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387800.220592:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690796032 00000100:00100000:2.0:1787387800.220602:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690796032 00000100:00100000:2.0:1787387800.220657:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1787387800.220668:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:9671:x1874211690796032:12345-192.168.204.59@tcp:35:rm.0 00000100:00100000:2.0:1787387800.221076:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:9671:x1874211690796032:12345-192.168.204.59@tcp:35:rm.0 Request processed in 407us (617us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787387800.221084:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:1.0:1787387800.227087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387800.227172:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690796288 00000100:00100000:3.0:1787387800.227182:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690796288 00000100:00100000:3.0:1787387800.227246:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1787387800.227256:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:9671:x1874211690796288:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:3.0:1787387800.227331:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787387800.227360:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c780b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52825 expref: 16 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.227537:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43821cfc00/0x93d41aeaa23c77a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52802 expref: 15 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.227553:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d4343c46d00) 00010000:00010000:3.0:1787387800.227570:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ea00/0x93d41aeaa23c776a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527f4 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.227579:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:3.0:1787387800.227586:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387800.227609:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7851 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.227621:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7851 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.227650:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7851 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.227664:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c7858 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.227671:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c7858 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.227677:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c7858 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.228375:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4200/0x93d41aeaa23c785f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.228397:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4200/0x93d41aeaa23c785f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.228404:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4200/0x93d41aeaa23c785f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387800.229222:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787387800.229238:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4200/0x93d41aeaa23c785f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229246:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4200/0x93d41aeaa23c785f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229254:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4200/0x93d41aeaa23c785f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229260:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387800.229264:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4200/0x93d41aeaa23c785f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229272:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4200/0x93d41aeaa23c785f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229284:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d4358720200) 00010000:00010000:1.0:1787387800.229287:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787387800.229291:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4200/0x93d41aeaa23c785f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229298:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4200/0x93d41aeaa23c785f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229327:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7851 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229333:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7851 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229339:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7851 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229344:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387800.229347:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7851 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229353:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7851 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229361:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:1.0:1787387800.229363:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387800.229366:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7851 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387800.229372:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7851 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787387800.229446:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000298449c5 reply state 00000000c7bfe87f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c7858 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387800.229456:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787387800.229545:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:9671:x1874211690796288:12345-192.168.204.59@tcp:36:rm.0 Request processed in 2287us (2465us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787387800.229555:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00010000:00010000:3.0:1787387800.231786:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c7858 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.231970:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c7858 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.231979:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c7858 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.231986:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387800.231990:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c7858 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.231997:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c7858 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.232013:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d4343c2d900) 00010000:00010000:3.0:1787387800.232015:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387800.232019:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c7858 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387800.232035:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e400/0x93d41aeaa23c7858 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387800.926074:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387801.950862:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387802.205973:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387802.205996:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709704448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387802.206062:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387802.206143:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709704448 00000100:00100000:0.0:1787387802.206149:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709704448 00000100:00100000:0.0:1787387802.206196:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787387802.206210:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709704448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387802.206245:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387802.206284:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709704448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387802.206292:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787387802.206310:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787387802.206339:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345014380 x1874211709704448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387802.206358:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709704448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387802.207047:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387802.207059:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709704960:0@lo:400:kworker.0 00000100:00100000:0.0:1787387802.207070:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709704704:0@lo:400:kworker.0 00000100:00100000:3.0:1787387802.207097:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387802.207097:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387802.207118:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709704576:0@lo:400:kworker.0 00000100:00100000:0.0:1787387802.207118:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387802.207122:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709704832:0@lo:400:kworker.0 00000100:00100000:0.0:1787387802.207139:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387802.207153:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387802.207177:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709705088:0@lo:400:kworker.0 00000100:00100000:0.0:1787387802.209167:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709704960 00000100:00100000:0.0:1787387802.209180:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709704960 00000100:00100000:0.0:1787387802.209252:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787387802.209276:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709704960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387802.209344:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709704960:12345-0@lo:400:kworker.0 Request processed in 85us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387802.209352:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787387802.209377:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709704704 00000100:00100000:0.0:1787387802.209381:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709704704 00000100:00100000:0.0:1787387802.209405:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709704832 00000100:00100000:0.0:1787387802.209408:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709704832 00000100:00100000:0.0:1787387802.209430:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787387802.209437:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709704704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387802.209482:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709704704:12345-0@lo:400:kworker.0 Request processed in 45us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387802.209488:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787387802.209500:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787387802.209505:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709704832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387802.209533:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709704832:12345-0@lo:400:kworker.0 Request processed in 27us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387802.209539:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787387802.209560:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709704576 00000100:00100000:0.0:1787387802.209564:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709704576 00000100:00100000:0.0:1787387802.209587:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787387802.209593:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709704576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387802.209625:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709704576:12345-0@lo:400:kworker.0 Request processed in 32us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387802.209630:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:0.0:1787387802.209671:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787387802.209677:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387802.209707:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709704832:0@lo:400:kworker.0 00000100:00100000:0.0:1787387802.209721:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709704704:0@lo:400:kworker.0 00000100:00100000:3.0:1787387802.211215:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709704576:0@lo:400:kworker.0 00010000:00080000:3.0:1787387802.211256:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a087b80 x1874211709704960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387802.211268:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709704960:0@lo:400:kworker.0 00000100:00100000:2.0:1787387802.212229:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387802.212391:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709705088 00000100:00100000:0.0:1787387802.212400:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709705088 00000100:00100000:0.0:1787387802.212468:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787387802.212478:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709705088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387802.212540:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709705088:12345-0@lo:400:kworker.0 Request processed in 64us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387802.212564:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787387802.212569:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709705088:0@lo:400:kworker.0 00000100:00080000:2.0:1787387802.212616:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787387802.980185:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787387803.230089:0:6858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307679346496ns, next at 308679343846ns, rc = 0 00000100:00100000:0.0:1787387803.230174:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709705216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387803.230244:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387803.230416:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709705216 00000100:00100000:3.0:1787387803.230424:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709705216 00000100:00100000:3.0:1787387803.230475:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787387803.230485:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709705216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787387803.230520:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387803.230583:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709705216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387803.230589:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787387803.230670:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345014380 x1874211709705216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387803.230689:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709705216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387803.999093:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387804.074304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387804.074338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387804.074447:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387804.074476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387804.074507:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690796672 00000100:00100000:1.0:1787387804.074516:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690796672 00000100:00100000:1.0:1787387804.074585:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:1.0:1787387804.074596:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2351:x1874211690796672:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387804.074668:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2351:x1874211690796672:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387804.074677:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00080000:1.0:1787387804.074697:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387804.074897:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690796416 00000100:00100000:3.0:1787387804.074902:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690796416 00000100:00100000:3.0:1787387804.074954:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 255 00000100:00100000:3.0:1787387804.074961:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434657b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2351:x1874211690796416:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387804.074998:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434657b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2351:x1874211690796416:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 37us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387804.075005:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 255 00000100:00100000:2.0:1787387804.075399:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690796544 00000100:00100000:2.0:1787387804.075404:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690796544 00000100:00100000:2.0:1787387804.075480:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690796800 00000100:00100000:2.0:1787387804.075484:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690796800 00000100:00100000:3.0:1787387804.075521:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00100000:3.0:1787387804.075529:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:2351:x1874211690796544:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387804.075589:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:2351:x1874211690796544:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 60us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387804.075596:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00080000:1.0:1787387804.080718:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387804.080980:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:2.0:1787387804.080994:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2351:x1874211690796800:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387804.081110:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2351:x1874211690796800:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 120us (6770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387804.081118:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 115 00000001:02000400:1.0:1787387804.367525:0:11489:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787387805.022937:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787387805.209096:0:11537:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff5d757fd0 00000020:00000080:0.0:1787387805.209115:0:11537:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787387805.209120:0:11537:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787387805.209127:0:11537:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5d75a260 20000000:00000080:0.0:1787387805.209135:0:11537:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d437f7f7400 uarg=0000000000000000 20000000:01000000:0.0:1787387805.209178:0:11537:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787387805.209184:0:11537:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787387805.209190:0:11537:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787387805.210570:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787387805.211131:0:11537:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787387805.220015:0:11537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787387805.220079:0:11537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787387805.220137:0:11537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787387805.220154:0:11537:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787387805.220175:0:11537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.220194:0:11537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4342ad4c00/0x93d41aeaa23c770f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7708 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.220203:0:11537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d43821ce400/0x93d41aeaa23c771d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7716 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.220220:0:11537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d43821cf400/0x93d41aeaa23c772b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7724 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.220245:0:11537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4342ad5c00/0x93d41aeaa23c7732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527df expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.220253:0:11537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4342ad5000/0x93d41aeaa23c7739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527e6 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.220261:0:11537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.220313:0:11537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4342ad5000/0x93d41aeaa23c7739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527e6 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.220330:0:11537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4342ad5000/0x93d41aeaa23c7739 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527e6 expref: 12 pid: 5800 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387805.220345:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11537:1874211709705344:192.168.204.59@tcp:104: 00010000:00010000:1.0:1787387805.220448:0:11537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4342ad5c00/0x93d41aeaa23c7732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527df expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.220457:0:11537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4342ad5c00/0x93d41aeaa23c7732 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527df expref: 12 pid: 5802 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387805.220466:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11537:1874211709705472:192.168.204.59@tcp:104: 00010000:00010000:1.0:1787387805.220493:0:11537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d43821cf400/0x93d41aeaa23c772b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c7724 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.221192:0:11537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d43821cf400/0x93d41aeaa23c772b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c7724 expref: 18 pid: 5800 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387805.221206:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11537:1874211709705600:0@lo:104: 00000100:00100000:1.0:1787387805.221251:0:11537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387805.221303:0:11537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d43821ce400/0x93d41aeaa23c771d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c7716 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.221312:0:11537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d43821ce400/0x93d41aeaa23c771d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c7716 expref: 18 pid: 5801 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387805.221321:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11537:1874211709705728:0@lo:104: 00000100:00100000:1.0:1787387805.221340:0:11537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387805.221370:0:11537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4342ad4c00/0x93d41aeaa23c770f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c7708 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.221377:0:11537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4342ad4c00/0x93d41aeaa23c770f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c7708 expref: 18 pid: 5800 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387805.221385:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11537:1874211709705856:0@lo:104: 00000100:00100000:1.0:1787387805.221407:0:11537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387805.221415:0:11537:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350d12540 going to sleep for 11 seconds 00000100:00100000:2.0:1787387805.221478:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787387805.221496:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709705600 00000100:00100000:2.0:1787387805.221503:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709705600 00000100:00100000:2.0:1787387805.221540:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709705728 00000100:00100000:2.0:1787387805.221544:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709705728 00000100:00100000:2.0:1787387805.221554:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709705856 00000100:00100000:2.0:1787387805.221556:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709705856 00000100:00100000:2.0:1787387805.221568:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787387805.221576:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:11537:x1874211709705600:12345-0@lo:104: 00010000:00010000:2.0:1787387805.221601:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387805.221680:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387805.221686:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+5:11537:x1874211709705600:12345-0@lo:104: Request processed in 111us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387805.221695:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787387805.221716:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787387805.221723:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:11537:x1874211709705728:12345-0@lo:104: 00000100:00100000:1.0:1787387805.221727:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11537:1874211709705600:0@lo:104: 00010000:00010000:2.0:1787387805.221732:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.221807:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387805.221815:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387805.221819:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787387805.221824:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e600 already unused, calling callback (ffffffffc1b81c20) 00000100:00100000:2.0:1787387805.221827:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+4:11537:x1874211709705728:12345-0@lo:104: Request processed in 105us (485us total) trans 0 rc 0/0 10000000:00010000:1.0:1787387805.221837:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387805.221853:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1787387805.221866:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387805.221870:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787387805.221879:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372019050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:11537:x1874211709705856:12345-0@lo:104: 10000000:00010000:1.0:1787387805.221887:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387805.221891:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387805.221898:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787387805.221933:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387805.221936:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787387805.221944:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787387805.221947:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372019050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+3:11537:x1874211709705856:12345-0@lo:104: Request processed in 68us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387805.221958:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787387805.221973:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.221983:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c7724 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c772b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.221997:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787387805.222001:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387805.222002:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387805.222011:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90800 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387805.222015:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.222022:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387805.222039:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387805.222045:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787387805.222068:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.222075:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387805.222089:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.222096:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4242f90800/0x93d41aeaa23c7716 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c771d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387805.222106:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387805.222109:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387805.222111:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387805.222122:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387805.222134:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709705984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387805.222169:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787387805.222183:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387805.222190:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387805.222198:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43821cfe00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:2.0:1787387805.222202:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387805.222210:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387805.222217:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387805.222223:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787387805.222242:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387805.222258:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387805.222266:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387805.222272:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d43821cfe00/0x93d41aeaa23c7708 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c770f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387805.222281:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11537:1874211709705728:0@lo:104: 00010000:00010000:2.0:1787387805.222289:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387805.222292:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387805.222295:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387805.222297:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11537:1874211709705856:0@lo:104: 00010000:00010000:2.0:1787387805.222308:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387805.222313:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387805.222625:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709705984 00000100:00100000:0.0:1787387805.222632:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709705984 00010000:00010000:0.0:1787387805.222653:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d43821cf400/0x93d41aeaa23c772b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7724 expref: 19 pid: 5800 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387805.222684:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787387805.222691:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709705984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387805.222702:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387805.222707:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d43821cf400/0x93d41aeaa23c772b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7724 expref: 19 pid: 5800 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.222714:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d43821cf400/0x93d41aeaa23c772b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c7724 expref: 19 pid: 5800 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.222726:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43821cf400/0x93d41aeaa23c772b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c7724 expref: 19 pid: 5800 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.222809:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387805.222846:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:3311:x1874211709705984:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387805.222863:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787387805.223101:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709705984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387805.223454:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709706112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387805.223493:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387805.223531:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387805.223537:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709706240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387805.223561:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387805.227334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387805.227429:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11537:1874211709705344:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387805.227444:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11537:1874211709705472:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387805.227477:0:11537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387805.227573:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709706112 00000100:00100000:2.0:1787387805.227794:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709706112 00000100:00100000:0.0:1787387805.227895:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709706240 00000100:00100000:0.0:1787387805.227900:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709706240 00010000:00010000:0.0:1787387805.227931:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4342ad4c00/0x93d41aeaa23c770f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7708 expref: 19 pid: 5800 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387805.227971:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787387805.227980:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709706240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387805.227995:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387805.228000:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4342ad4c00/0x93d41aeaa23c770f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7708 expref: 19 pid: 5800 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.228010:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4342ad4c00/0x93d41aeaa23c770f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c7708 expref: 19 pid: 5800 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.228027:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad4c00/0x93d41aeaa23c770f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c7708 expref: 19 pid: 5800 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.228041:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387805.228137:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:3313:x1874211709706240:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (4574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387805.228144:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1787387805.229969:0:11042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d43821ce400/0x93d41aeaa23c771d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7716 expref: 17 pid: 5801 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387805.230024:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787387805.230046:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345014380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:3313:x1874211709706112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387805.230061:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387805.230067:0:11042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d43821ce400/0x93d41aeaa23c771d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c7716 expref: 17 pid: 5801 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.230078:0:11042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d43821ce400/0x93d41aeaa23c771d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c7716 expref: 17 pid: 5801 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.230094:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43821ce400/0x93d41aeaa23c771d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c7716 expref: 17 pid: 5801 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.230109:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387805.230162:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345014380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:3313:x1874211709706112:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (6668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387805.230169:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787387805.234729:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709706240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387805.234887:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709706112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387805.235045:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690796928 00000100:00100000:0.0:1787387805.235053:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690796928 00000100:00100000:1.0:1787387805.235061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:0.0:1787387805.235092:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4342ad5000/0x93d41aeaa23c7739 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527e6 expref: 13 pid: 5800 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387805.235132:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690797056 00000100:00100000:3.0:1787387805.235138:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690797056 00000100:00100000:0.0:1787387805.235138:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:0.0:1787387805.235148:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690796928:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387805.235167:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387805.235173:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4342ad5c00/0x93d41aeaa23c7732 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527df expref: 14 pid: 5802 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.235175:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4342ad5000/0x93d41aeaa23c7739 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527e6 expref: 14 pid: 5800 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.235199:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4342ad5000/0x93d41aeaa23c7739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527e6 expref: 14 pid: 5800 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387805.235217:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:3.0:1787387805.235226:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+14:2350:x1874211690797056:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387805.235232:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad5000/0x93d41aeaa23c7739 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527e6 expref: 14 pid: 5800 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235236:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387805.235245:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4342ad5c00/0x93d41aeaa23c7732 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527df expref: 13 pid: 5802 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.235253:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387805.235258:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4342ad5c00/0x93d41aeaa23c7732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527df expref: 13 pid: 5802 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235271:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad5c00/0x93d41aeaa23c7732 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527df expref: 13 pid: 5802 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235284:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235293:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235310:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387805.235311:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:2350:x1874211690796928:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 160us (7984us total) trans 0 rc 0/0 00010000:00010000:3.0:1787387805.235327:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387805.235329:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00010000:00010000:3.0:1787387805.235339:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235347:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235359:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4a00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387805.235364:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235373:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235389:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235400:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387805.235423:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:2350:x1874211690797056:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 199us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387805.235430:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00010000:00010000:3.0:1787387805.235459:0:11537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235467:0:11537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387805.235474:0:11537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad4a00/0x93d41aeaa23c7866 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787387805.356538:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000001:00080000:3.0:1787387805.356558:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787387805.356571:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:3.0:1787387805.356593:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:0.0:1787387805.356942:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387805.356965:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709706368:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787387805.357033:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387805.357109:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709706368 00000100:00100000:0.0:1787387805.357116:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709706368 00000100:00100000:0.0:1787387805.357174:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387805.357183:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709706368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787387805.357209:0:6606:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787387805.357244:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a895f98, atime: 0x6a895f98, ctime: 0x6a895f98, blocks: 0x1 00010000:00010000:0.0:1787387805.357253:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c786d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.357268:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=309s v=(0 0) 00010000:00010000:0.0:1787387805.357273:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387805.357279:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c786d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.357296:0:6606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c786d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.357320:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c786d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.357328:0:6606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c786d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.357346:0:6606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787387805.358232:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709706368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1045us (1194us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787387805.358245:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787387805.358281:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787387805.358295:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387805.358302:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c786d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.358313:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387805.358318:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c786d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.358328:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c786d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.358350:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c786d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.358372:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c786d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387805.358393:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387805.358394:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387805.358396:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787387805.358433:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d437a085500/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787387805.358439:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709706368:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787387806.047364:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387806.698200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387806.698372:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690797184 00000100:00100000:1.0:1787387806.698384:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690797184 00000100:00100000:1.0:1787387806.698468:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 256 00000100:00100000:1.0:1787387806.698478:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:5569:x1874211690797184:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387806.698507:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387806.698527:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4342ad5400/0x93d41aeaa23c7874 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52833 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387806.698554:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad5400/0x93d41aeaa23c7874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52833 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387806.698563:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4342ad5400/0x93d41aeaa23c7874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52833 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387806.698571:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5400, rc 0) 00000100:00100000:1.0:1787387806.698713:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690797184:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 236us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387806.698721:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 256 00000100:00100000:0.0:1787387806.710567:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387806.710845:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690797312 00000100:00100000:1.0:1787387806.710856:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690797312 00000100:00100000:1.0:1787387806.710915:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 257 00000100:00100000:1.0:1787387806.710926:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690797312:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387806.711355:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690797312:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 430us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387806.711364:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 257 00000100:00100000:2.0:1787387806.718575:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387806.718793:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690797440 00000100:00100000:3.0:1787387806.718803:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690797440 00000100:00100000:3.0:1787387806.718877:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 258 00000100:00100000:3.0:1787387806.718887:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690797440:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387806.719304:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690797440:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 417us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387806.719312:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 258 00000100:00100000:2.0:1787387806.726822:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387806.738797:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690797568 00000100:00100000:0.0:1787387806.738816:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690797568 00000100:00100000:0.0:1787387806.739074:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 259 00000100:00100000:0.0:1787387806.739086:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:9941:x1874211690797568:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787387806.739502:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:9941:x1874211690797568:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 417us (12688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387806.739510:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 259 00000100:00100000:0.0:1787387806.747139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387806.747320:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690797696 00000100:00100000:1.0:1787387806.747329:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690797696 00000100:00100000:1.0:1787387806.747374:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 260 00000100:00100000:1.0:1787387806.747383:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:9941:x1874211690797696:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787387806.747850:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:9941:x1874211690797696:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 466us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387806.747864:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 260 00000100:00100000:1.0:1787387806.764905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387806.765654:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690797824 00000100:00100000:3.0:1787387806.765667:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690797824 00000100:00100000:3.0:1787387806.765726:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 261 00000100:00100000:3.0:1787387806.765778:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:5569:x1874211690797824:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387806.765799:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387806.765819:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c787b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5283a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387806.765848:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c787b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5283a expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387806.765860:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c787b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5283a expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387806.765870:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e400, rc 0) 00000100:00100000:3.0:1787387806.765927:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:5569:x1874211690797824:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 151us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387806.765934:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 261 00000100:00100000:2.0:1787387806.778548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387806.784098:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690797952 00000100:00100000:0.0:1787387806.784114:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690797952 00000100:00100000:0.0:1787387806.784247:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 262 00000100:00100000:0.0:1787387806.784258:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:5569:x1874211690797952:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387806.785045:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:5569:x1874211690797952:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 785us (6504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387806.785066:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 262 00000100:00100000:0.0:1787387806.788504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387806.788778:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690798080 00000100:00100000:1.0:1787387806.788787:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690798080 00000100:00100000:1.0:1787387806.788845:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 263 00000100:00100000:1.0:1787387806.788855:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:5569:x1874211690798080:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387806.789101:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:5569:x1874211690798080:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 246us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387806.789109:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 263 00000100:00100000:1.0:1787387806.796027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387806.796361:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690798208 00000100:00100000:3.0:1787387806.796371:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690798208 00000100:00100000:3.0:1787387806.796431:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 264 00000100:00100000:3.0:1787387806.796442:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:9944:x1874211690798208:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787387806.796815:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:9944:x1874211690798208:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 375us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387806.796824:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 264 00000100:00100000:0.0:1787387806.809316:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387806.809408:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690798336 00000100:00100000:1.0:1787387806.809419:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690798336 00000100:00100000:1.0:1787387806.809483:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 265 00000100:00100000:1.0:1787387806.809495:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:9944:x1874211690798336:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787387806.809811:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:9944:x1874211690798336:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 317us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387806.809819:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 265 00010000:00010000:2.0:1787387807.073333:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787387807.197863:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787387807.197870:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4377c90800 from 7 10000000:01000000:2.0:1787387807.197876:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387807.197925:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387807.197937:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387807.197967:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387807.197993:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709706496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.198062:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387807.198136:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253000 going to sleep for 11 seconds 00000100:00100000:1.0:1787387807.198379:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709706496 00000100:00100000:1.0:1787387807.198388:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709706496 00000100:00100000:1.0:1787387807.198441:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787387807.198451:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:5804:x1874211709706496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387807.198465:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387807.198479:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4342ad4200/0x93d41aeaa23c7889 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7882 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387807.198532:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4342ad4200/0x93d41aeaa23c7889 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7882 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387807.198542:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4342ad4200/0x93d41aeaa23c7889 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7882 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387807.198550:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4200, rc 0) 00000100:00100000:1.0:1787387807.199041:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709706496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 591us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387807.199050:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787387807.199320:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709706496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387807.199339:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387807.199349:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387807.199413:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709706624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.199448:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387807.199483:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253000 going to sleep for 11 seconds 00000100:00100000:3.0:1787387807.199522:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709706624 00000100:00100000:3.0:1787387807.199527:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709706624 00000100:00100000:3.0:1787387807.199565:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787387807.199573:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709706624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387807.199865:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709706624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387807.199872:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787387807.199906:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709706624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.199936:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709706752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.199974:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387807.200004:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253000 going to sleep for 11 seconds 00000100:00100000:0.0:1787387807.200032:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709706752 00000100:00100000:0.0:1787387807.200036:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709706752 00000100:00100000:0.0:1787387807.200075:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787387807.200082:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709706752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387807.200241:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709706752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387807.200248:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787387807.200316:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709706752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387807.203612:0:11552:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345017480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11552:1874211709706880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387807.203704:0:11552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387807.203775:0:11552:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387807.205370:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709706880 00000100:00100000:1.0:1787387807.205388:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709706880 00000100:00100000:1.0:1787387807.205457:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787387807.205468:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:11552:x1874211709706880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387807.205849:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:11552:x1874211709706880:12345-0@lo:502:llog_process_th.0 Request processed in 383us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387807.205857:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787387807.206410:0:11552:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345017480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11552:1874211709706880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787387807.206518:0:11552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387807.206529:0:11552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387807.206530:0:11552:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787387807.206537:0:11552:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4377c90800 00000020:00000080:0.0:1787387807.206540:0:11552:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787387807.206716:0:11552:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11552:1874211709707008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387807.211238:0:11552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387807.211374:0:11552:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a8da9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387807.213834:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709707008 00000100:00100000:2.0:1787387807.213851:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709707008 00000100:00100000:2.0:1787387807.213919:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787387807.213930:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:11552:x1874211709707008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387807.214259:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:11552:x1874211709707008:12345-0@lo:502:llog_process_th.0 Request processed in 331us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387807.214274:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787387807.214382:0:11552:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11552:1874211709707008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787387807.214419:0:11552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387807.214438:0:11552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387807.214440:0:11552:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787387807.214445:0:11552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787387807.214864:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787387807.214885:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387807.214896:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387807.214908:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387807.214918:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787387807.214921:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4379110800 from 7 10000000:01000000:2.0:1787387807.214923:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387807.214955:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387807.214963:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387807.214973:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387807.214994:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709707136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.215035:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387807.215086:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387807.215206:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709707136 00000100:00100000:3.0:1787387807.215213:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709707136 00000100:00100000:3.0:1787387807.215249:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787387807.215269:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+17:5804:x1874211709707136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387807.215280:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387807.215293:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152ea00/0x93d41aeaa23c7897 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c7890 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387807.215314:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152ea00/0x93d41aeaa23c7897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c7890 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387807.215324:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152ea00/0x93d41aeaa23c7897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c7890 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387807.215342:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152ea00, rc 0) 00000100:00100000:3.0:1787387807.215382:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709707136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387807.215388:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787387807.215761:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709707136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387807.215778:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387807.215788:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387807.215851:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709707264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.215882:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387807.215915:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387807.215962:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709707264 00000100:00100000:0.0:1787387807.215968:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709707264 00000100:00100000:0.0:1787387807.215996:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787387807.216002:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709707264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.216356:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709707264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.216383:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709707392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.216419:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387807.216449:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387807.216462:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709707392 00000100:00100000:2.0:1787387807.216466:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709707392 00000100:00100000:2.0:1787387807.216484:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787387807.216490:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709707392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.216629:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709707392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387807.216647:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787387807.216689:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709707392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.216873:0:11554:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11554:1874211709707520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387807.216911:0:11554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387807.216930:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709707520 00000100:00100000:2.0:1787387807.216933:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709707520 00000100:00100000:2.0:1787387807.216948:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787387807.216954:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:11554:x1874211709707520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387807.217073:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:11554:x1874211709707520:12345-0@lo:502:llog_process_th.0 Request processed in 118us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387807.217089:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787387807.217114:0:11554:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253300 going to sleep for 11 seconds 00000100:00100000:2.0:1787387807.217127:0:11554:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11554:1874211709707520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387807.217145:0:11554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387807.217153:0:11554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387807.217155:0:11554:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787387807.217163:0:11554:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4379110800 00000020:00000080:2.0:1787387807.217165:0:11554:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787387807.218148:0:11554:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11554:1874211709707648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387807.218214:0:11554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387807.218229:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709707264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387807.218238:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787387807.218247:0:11554:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387807.218352:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709707648 00000100:00100000:0.0:1787387807.218358:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709707648 00000100:00100000:0.0:1787387807.218394:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787387807.218401:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:11554:x1874211709707648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387807.218637:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:11554:x1874211709707648:12345-0@lo:502:llog_process_th.0 Request processed in 236us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387807.218656:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787387807.219644:0:11554:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11554:1874211709707648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387807.219682:0:11554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387807.219691:0:11554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387807.219693:0:11554:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787387807.219698:0:11554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787387807.220380:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787387807.220400:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387807.220411:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387807.220500:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387807.220513:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787387807.220515:0:5804:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4350ce4000 from 7 10000000:01000000:2.0:1787387807.220517:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387807.220557:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387807.220564:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387807.220573:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387807.220598:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709707776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.221105:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387807.221158:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253300 going to sleep for 11 seconds 00000100:00100000:0.0:1787387807.221241:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709707776 00000100:00100000:0.0:1787387807.221250:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709707776 00000100:00100000:0.0:1787387807.221371:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787387807.221379:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:5804:x1874211709707776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387807.221392:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387807.221407:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4377c70600/0x93d41aeaa23c78a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c789e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387807.221510:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4377c70600/0x93d41aeaa23c78a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c789e expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387807.221523:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4377c70600/0x93d41aeaa23c78a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c789e expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387807.221532:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70600, rc 0) 00000100:00100000:0.0:1787387807.221584:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709707776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387807.221600:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787387807.224397:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709707776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387807.224427:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387807.224440:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387807.224535:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709707904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387807.224606:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387807.224648:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643540 going to sleep for 11 seconds 00000100:00100000:2.0:1787387807.224802:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709707904 00000100:00100000:2.0:1787387807.224809:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709707904 00000100:00100000:2.0:1787387807.224889:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787387807.224898:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709707904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.225176:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709707904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387807.225183:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787387807.225263:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709707904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387807.225292:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709708032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387807.225335:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387807.233070:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387807.240446:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709708032 00000100:00100000:0.0:1787387807.240462:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709708032 00000100:00100000:0.0:1787387807.240520:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787387807.240530:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709708032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387807.240818:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:5804:x1874211709708032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 288us (15480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387807.240826:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787387807.242254:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345014380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:5804:1874211709708032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387807.242545:0:11556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11556:1874211709708160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387807.242609:0:11556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387807.242657:0:11556:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253600 going to sleep for 11 seconds 00000100:00100000:1.0:1787387807.244138:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709708160 00000100:00100000:1.0:1787387807.244153:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709708160 00000100:00100000:1.0:1787387807.244211:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787387807.244222:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:11556:x1874211709708160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387807.246525:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:11556:x1874211709708160:12345-0@lo:502:llog_process_th.0 Request processed in 268us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387807.246547:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787387807.248490:0:11556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11556:1874211709708160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387807.248535:0:11556:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387807.248545:0:11556:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387807.248547:0:11556:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787387807.248555:0:11556:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4350ce4000 00000020:00000080:2.0:1787387807.248558:0:11556:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787387807.249008:0:11556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11556:1874211709708288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387807.249080:0:11556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387807.249117:0:11556:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374253600 going to sleep for 11 seconds 00000100:00100000:1.0:1787387807.260488:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709708288 00000100:00100000:1.0:1787387807.260505:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709708288 00000100:00100000:1.0:1787387807.260652:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787387807.260662:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:11556:x1874211709708288:12345-0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787387807.261901:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787387807.263640:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:11556:x1874211709708288:12345-0@lo:502:llog_process_th.0 Request processed in 2970us (14551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387807.263655:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787387807.271773:0:11556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:11556:1874211709708288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387807.271830:0:11556:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387807.271851:0:11556:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387807.271854:0:11556:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787387807.271859:0:11556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787387807.271932:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787387807.271952:0:5804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387807.271964:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387807.271975:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387807.330014:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709708416:0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330090:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387807.330140:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709708928:0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330163:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387807.330194:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387807.330202:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709708800:0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330224:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387807.330260:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709708544:0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330281:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387807.330300:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387807.330307:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709708672:0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330328:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387807.330368:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709708416 00000100:00100000:3.0:1787387807.330375:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709708416 00000100:00100000:3.0:1787387807.330416:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709708800 00000100:00100000:3.0:1787387807.330418:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709708800 00000100:00100000:3.0:1787387807.330439:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709708544 00000100:00100000:3.0:1787387807.330442:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709708544 00000100:00100000:3.0:1787387807.330457:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787387807.330464:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709708416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330517:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709708416:12345-0@lo:400:kworker.0 Request processed in 52us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387807.330524:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787387807.330541:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787387807.330547:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709708800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330583:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709708800:12345-0@lo:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387807.330606:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787387807.330620:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787387807.330627:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709708544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330658:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709708544:12345-0@lo:400:kworker.0 Request processed in 32us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387807.330663:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787387807.330679:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709708928 00000100:00100000:3.0:1787387807.330682:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709708928 00000100:00100000:3.0:1787387807.330705:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709708672 00000100:00100000:3.0:1787387807.330708:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709708672 00000100:00100000:3.0:1787387807.330762:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787387807.330770:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709708928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330812:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709708928:12345-0@lo:400:kworker.0 Request processed in 44us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387807.330817:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787387807.330828:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787387807.330833:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874211709708672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330856:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874211709708672:12345-0@lo:400:kworker.0 Request processed in 23us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387807.330861:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787387807.330889:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387807.330892:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787387807.330895:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387807.330931:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709708672:0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330953:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709708544:0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330983:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709708800:0@lo:400:kworker.0 00000100:00100000:3.0:1787387807.330992:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709708416:0@lo:400:kworker.0 00010000:00080000:3.0:1787387807.331002:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4374489180 x1874211709708928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387807.331011:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709708928:0@lo:400:kworker.0 00000100:00100000:0.0:1787387807.331780:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709709056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387807.331828:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387807.332025:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709709056 00000100:00100000:2.0:1787387807.332031:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709709056 00000100:00100000:2.0:1787387807.332062:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787387807.332069:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709709056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787387807.332098:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387807.332136:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709709056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387807.332143:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787387807.332433:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43720a8700 x1874211709709056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387807.332450:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709709056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787387808.095361:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787387808.286711:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787387808.350841:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709709184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387808.350918:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387808.356968:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709709184 00000100:00100000:1.0:1787387808.356983:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709709184 00000100:00100000:1.0:1787387808.357093:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787387808.357104:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709709184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787387808.357145:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387808.357241:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709709184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (6323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387808.357250:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787387808.357347:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709709184:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787387809.118836:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387809.198426:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387809.198478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387809.198601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387809.198640:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690798720 00000100:00100000:3.0:1787387809.198651:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690798720 00000100:00100000:2.0:1787387809.198770:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690798464 00000100:00100000:2.0:1787387809.198775:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690798464 00000100:00080000:0.0:1787387809.198791:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387809.198803:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:2.0:1787387809.198811:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 281 00000100:00100000:3.0:1787387809.198819:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690798720:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387809.198824:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2353:x1874211690798464:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387809.198917:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2353:x1874211690798464:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 97us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387809.198925:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 281 00000100:00100000:0.0:1787387809.198952:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690798720:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 140us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387809.198959:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1787387809.199220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387809.199275:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690798592 00000100:00100000:0.0:1787387809.199279:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690798592 00000100:00100000:0.0:1787387809.199308:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690798848 00000100:00100000:0.0:1787387809.199311:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690798848 00000100:00100000:0.0:1787387809.199339:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00100000:0.0:1787387809.199347:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690798592:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387809.199355:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:2.0:1787387809.199361:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2353:x1874211690798848:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387809.199382:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690798592:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 36us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387809.199383:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2353:x1874211690798848:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 22us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387809.199389:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:0.0:1787387809.199395:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00080000:3.0:1787387809.199567:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787387810.144294:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787387810.455710:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1787387811.165946:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387812.192313:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387812.447706:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709709696:0@lo:400:kworker.0 00000100:00100000:3.0:1787387812.447818:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387812.447904:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387812.447911:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709709568:0@lo:400:kworker.0 00000100:00100000:3.0:1787387812.447951:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387812.447992:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709709696 00000100:00100000:3.0:1787387812.448001:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709709696 00000100:00100000:3.0:1787387812.448066:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787387812.448076:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709709696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387812.448154:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709709440:0@lo:400:kworker.0 00000100:00100000:3.0:1787387812.448173:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709709696:12345-0@lo:400:kworker.0 Request processed in 99us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387812.448181:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787387812.448200:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787387812.448205:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387812.448231:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709709952:0@lo:400:kworker.0 00000100:00100000:1.0:1787387812.448253:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387812.448255:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787387812.448260:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d437a085500, transno 4294967300 00000100:00100000:3.0:1787387812.448270:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709709696:0@lo:400:kworker.0 00000100:00100000:1.0:1787387812.448273:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787387812.448278:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709709312:0@lo:400:kworker.0 00000100:00100000:3.0:1787387812.448306:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709709568 00000100:00100000:3.0:1787387812.448310:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709709568 00000100:00100000:1.0:1787387812.448312:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387812.448330:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709709824:0@lo:400:kworker.0 00000100:00100000:3.0:1787387812.448338:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709709440 00000100:00100000:3.0:1787387812.448341:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709709440 00000100:00100000:1.0:1787387812.448350:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387812.448356:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709709824 00000100:00100000:3.0:1787387812.448358:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709709824 00000100:00100000:1.0:1787387812.448371:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787387812.448378:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709709568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387812.448413:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709709568:12345-0@lo:400:kworker.0 Request processed in 36us (461us total) trans 0 rc 0/0 00000100:00080000:2.0:1787387812.455885:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387812.461410:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787387812.461453:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709709440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387812.461584:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709709440:12345-0@lo:400:kworker.0 Request processed in 162us (13382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387812.461592:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787387812.461639:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787387812.461648:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709709824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387812.461682:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709709824:12345-0@lo:400:kworker.0 Request processed in 36us (13331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387812.461687:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787387812.461759:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709709312 00000100:00100000:3.0:1787387812.461767:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709709312 00000100:00100000:3.0:1787387812.461804:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787387812.461810:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709709312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387812.461857:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709709312:12345-0@lo:400:kworker.0 Request processed in 48us (13544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387812.461863:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787387812.462796:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709709952 00000100:00100000:3.0:1787387812.462805:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709709952 00000100:00100000:3.0:1787387812.462861:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787387812.462868:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709709952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387812.462916:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709709952:12345-0@lo:400:kworker.0 Request processed in 49us (14662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387812.462922:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787387812.462953:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387812.462989:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709710080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387812.463027:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387812.463286:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787387812.463336:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709709312:0@lo:400:kworker.0 00000100:00100000:1.0:1787387812.463350:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709709824:0@lo:400:kworker.0 00000100:00100000:1.0:1787387812.463362:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709709440:0@lo:400:kworker.0 00010000:00080000:1.0:1787387812.463373:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4345dcc380 x1874211709709952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387812.463384:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709709952:0@lo:400:kworker.0 00000100:00100000:1.0:1787387812.463425:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709709568:0@lo:400:kworker.0 00000100:00100000:1.0:1787387812.463458:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709710080 00000100:00100000:1.0:1787387812.463462:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709710080 00000100:00100000:1.0:1787387812.463490:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787387812.463498:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709710080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387812.463523:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387812.463555:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709710080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387812.463561:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787387812.465735:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43720a8380 x1874211709710080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387812.465776:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709710080:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787387813.217400:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387813.470784:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387813.470807:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709710208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387813.470887:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387813.471158:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709710208 00000100:00100000:0.0:1787387813.471166:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709710208 00000100:00100000:0.0:1787387813.471222:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787387813.471231:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709710208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787387813.471271:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387813.471325:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709710208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387813.471331:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787387813.471667:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709710208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387814.238173:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387814.316338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387814.316390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387814.316440:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387814.316480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387814.316514:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690799232 00000100:00100000:1.0:1787387814.316525:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690799232 00000100:00100000:1.0:1787387814.316598:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:1.0:1787387814.316609:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690799232:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387814.316771:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690799104 00000100:00100000:2.0:1787387814.316777:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690799104 00000100:00100000:2.0:1787387814.316806:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690799360 00000100:00100000:2.0:1787387814.316810:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690799360 00000100:00100000:2.0:1787387814.316851:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:2.0:1787387814.316859:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690799104:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387814.316938:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690799104:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 80us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387814.316945:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:2.0:1787387814.316963:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:2.0:1787387814.316968:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690799360:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387814.316992:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690799360:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387814.316998:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:0.0:1787387814.317223:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690798976 00000100:00100000:0.0:1787387814.317228:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690798976 00000100:00100000:0.0:1787387814.317267:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 283 00000100:00100000:0.0:1787387814.317275:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690798976:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387814.317303:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690798976:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387814.317308:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 283 00000100:00100000:1.0:1787387814.317823:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690799232:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 1215us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387814.317958:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00080000:3.0:1787387814.318417:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387814.318425:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787387815.262791:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387816.286042:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387817.311085:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387817.567816:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709710720:0@lo:400:kworker.0 00000100:00100000:1.0:1787387817.567894:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387817.567962:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387817.567969:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709710592:0@lo:400:kworker.0 00000100:00100000:1.0:1787387817.567999:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387817.568033:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709710592 00000100:00100000:1.0:1787387817.568042:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709710592 00000100:00100000:1.0:1787387817.568099:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787387817.568109:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709710592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387817.568162:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709710592:12345-0@lo:400:kworker.0 Request processed in 55us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387817.568169:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787387817.568214:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709710592:0@lo:400:kworker.0 00000100:00100000:0.0:1787387817.568378:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709710336:0@lo:400:kworker.0 00000100:00100000:0.0:1787387817.568417:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387817.568451:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709710848:0@lo:400:kworker.0 00000100:00100000:0.0:1787387817.568475:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387817.568494:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787387817.568499:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709710464:0@lo:400:kworker.0 00000100:00100000:0.0:1787387817.568553:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387817.568570:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709710976:0@lo:400:kworker.0 00000100:00100000:0.0:1787387817.568591:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387817.568614:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709710848 00000100:00100000:0.0:1787387817.568619:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709710848 00000100:00100000:0.0:1787387817.568647:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709710464 00000100:00100000:0.0:1787387817.568650:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709710464 00000100:00100000:0.0:1787387817.568666:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787387817.568674:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709710848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387817.568709:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709710848:12345-0@lo:400:kworker.0 Request processed in 36us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387817.568716:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787387817.568728:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787387817.568733:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709710464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387817.568793:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709710464:12345-0@lo:400:kworker.0 Request processed in 60us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387817.568800:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787387817.568830:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709710464:0@lo:400:kworker.0 00000100:00100000:0.0:1787387817.568840:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709710848:0@lo:400:kworker.0 00000100:00100000:2.0:1787387817.568908:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709710336 00000100:00100000:2.0:1787387817.568919:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709710336 00000100:00100000:2.0:1787387817.568957:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787387817.568964:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709710336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387817.569003:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709710336:12345-0@lo:400:kworker.0 Request processed in 40us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387817.569010:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787387817.569089:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709710336:0@lo:400:kworker.0 00000100:00100000:3.0:1787387817.569275:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709711104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387817.569308:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387817.569352:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709710720 00000100:00100000:3.0:1787387817.569362:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709710720 00000100:00100000:3.0:1787387817.569399:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709710976 00000100:00100000:3.0:1787387817.569402:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709710976 00000100:00100000:3.0:1787387817.569426:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787387817.569432:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709710720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387817.569478:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709710720:12345-0@lo:400:kworker.0 Request processed in 34us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387817.569484:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787387817.569496:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787387817.569502:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709710976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387817.569544:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709710976:12345-0@lo:400:kworker.0 Request processed in 42us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387817.569549:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1787387817.569563:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787387817.569567:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387817.569569:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787387817.569595:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a749500 x1874211709710976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387817.569606:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709710976:0@lo:400:kworker.0 00000100:00100000:1.0:1787387817.570378:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709710720:0@lo:400:kworker.0 00000100:00100000:0.0:1787387817.570901:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709711104 00000100:00100000:0.0:1787387817.570909:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709711104 00000100:00100000:0.0:1787387817.570961:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787387817.570970:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709711104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387817.571006:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387817.571088:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709711104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387817.571095:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787387817.571214:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43720a9f80 x1874211709711104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387817.571233:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709711104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787387818.336149:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787387818.527760:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787387818.590167:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387818.590194:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709711232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387818.590266:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387818.590634:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709711232 00000100:00100000:0.0:1787387818.590641:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709711232 00000100:00100000:0.0:1787387818.590697:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787387818.590706:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709711232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787387818.590767:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387818.590829:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709711232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387818.590836:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787387818.598553:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709711232:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787387819.361859:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387819.432940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387819.432982:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387819.433022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387819.433062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387819.433094:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690799744 00000100:00100000:3.0:1787387819.433103:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690799744 00000100:00100000:1.0:1787387819.433126:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690799616 00000100:00100000:1.0:1787387819.433142:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690799616 00000100:00100000:3.0:1787387819.433159:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:3.0:1787387819.433170:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690799744:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387819.433170:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690799872 00000100:00100000:1.0:1787387819.433172:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690799872 00000100:00100000:1.0:1787387819.433190:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:1.0:1787387819.433197:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690799616:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387819.433266:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690799488 00000100:00100000:2.0:1787387819.433271:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690799488 00000100:00100000:2.0:1787387819.433300:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 285 00000100:00100000:2.0:1787387819.433308:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690799488:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387819.433368:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690799744:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 199us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387819.433376:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:0.0:1787387819.433538:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:0.0:1787387819.433549:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690799872:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387819.440424:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690799616:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 7212us (7480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387819.440441:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00080000:1.0:1787387819.440630:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787387819.440639:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387819.440678:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690799488:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 7367us (7651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387819.440689:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 285 00000100:00100000:0.0:1787387819.441611:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690799872:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 8057us (8621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387819.441622:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 130 00010000:00010000:0.0:1787387820.381903:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387821.407143:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387822.436391:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387822.686794:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709711360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387822.686880:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387822.687083:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709711360 00000100:00100000:0.0:1787387822.687092:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709711360 00000100:00100000:0.0:1787387822.687168:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787387822.687178:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709711360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387822.687216:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387822.687262:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709711360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387822.687270:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787387822.687311:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d43720a8a80 x1874211709711360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387822.687341:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709711360:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787387822.687477:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387822.688345:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709711744:0@lo:400:kworker.0 00000100:00100000:3.0:1787387822.688394:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387822.688440:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387822.688447:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709711616:0@lo:400:kworker.0 00000100:00100000:3.0:1787387822.688470:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387822.688497:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709711744 00000100:00100000:3.0:1787387822.688503:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709711744 00000100:00100000:3.0:1787387822.688554:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709711616 00000100:00100000:3.0:1787387822.688557:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709711616 00000100:00100000:3.0:1787387822.688577:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787387822.688584:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709711744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387822.688626:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709711744:12345-0@lo:400:kworker.0 Request processed in 42us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387822.688645:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787387822.688659:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787387822.688665:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709711616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387822.688694:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709711616:12345-0@lo:400:kworker.0 Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387822.688699:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787387822.688730:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709711616:0@lo:400:kworker.0 00000100:00100000:3.0:1787387822.688767:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709711744:0@lo:400:kworker.0 00000100:00100000:1.0:1787387822.688992:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709711488:0@lo:400:kworker.0 00000100:00100000:1.0:1787387822.689027:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387822.689054:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709712000:0@lo:400:kworker.0 00000100:00100000:1.0:1787387822.689074:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387822.689092:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387822.689097:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709711872:0@lo:400:kworker.0 00000100:00100000:1.0:1787387822.689118:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387822.689157:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709711872 00000100:00100000:1.0:1787387822.689161:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709711872 00000100:00100000:1.0:1787387822.689194:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787387822.689201:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709711872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387822.689236:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709711872:12345-0@lo:400:kworker.0 Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387822.689242:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1787387822.689261:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387822.689265:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387822.689290:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709711872:0@lo:400:kworker.0 00000100:00100000:1.0:1787387822.689308:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709712000 00000100:00100000:1.0:1787387822.689311:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709712000 00000100:00100000:1.0:1787387822.689334:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787387822.689340:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709712000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387822.689370:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709712000:12345-0@lo:400:kworker.0 Request processed in 31us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387822.689376:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1787387822.689390:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387822.689406:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709712000:0@lo:400:kworker.0 00000100:00100000:0.0:1787387822.689765:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709711488 00000100:00100000:0.0:1787387822.689770:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709711488 00000100:00100000:0.0:1787387822.689801:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787387822.689809:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709711488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387822.689846:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709711488:12345-0@lo:400:kworker.0 Request processed in 38us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387822.689853:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787387822.690471:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709711488:0@lo:400:kworker.0 00010000:00010000:0.0:1787387823.456695:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387823.710144:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387823.710173:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709712128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387823.710248:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387823.710662:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709712128 00000100:00100000:1.0:1787387823.710670:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709712128 00000100:00100000:1.0:1787387823.710735:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787387823.710768:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709712128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787387823.710806:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387823.710870:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709712128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387823.710877:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787387823.711041:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709712128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787387824.478096:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387824.555539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387824.555589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387824.555692:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690800128 00000100:00100000:1.0:1787387824.555703:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690800128 00000100:00100000:1.0:1787387824.555807:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:1.0:1787387824.555819:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690800128:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387824.555897:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690800128:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 80us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387824.555903:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00080000:2.0:1787387824.555978:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387824.556948:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690800000 00000100:00100000:3.0:1787387824.556956:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690800000 00000100:00100000:3.0:1787387824.557005:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 287 00000100:00100000:3.0:1787387824.557017:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690800000:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387824.557061:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690800000:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 46us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387824.557068:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 287 00000100:00100000:3.0:1787387824.576088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387824.576489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387824.576710:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690800384 00000100:00100000:1.0:1787387824.576721:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690800384 00000100:00100000:1.0:1787387824.576870:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:1.0:1787387824.576881:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690800384:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387824.576959:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690800384:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 79us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387824.576967:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:0.0:1787387824.577767:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690800256 00000100:00100000:0.0:1787387824.577774:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690800256 00000100:00080000:2.0:1787387824.580470:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387824.580481:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387824.581171:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:0.0:1787387824.581187:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2349:x1874211690800256:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:0.0:1787387824.581219:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c77e1 00000100:00080000:0.0:1787387824.581230:0:6605:0:(import.c:65:import_set_state_nolock()) ffff8d437aabd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787387824.581284:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1787387824.581583:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+2:2349:x1874211690800256:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 402us (5507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387824.581592:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00010000:00010000:3.0:1787387824.581788:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387825.502609:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787387825.859689:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000020:00000080:1.0:1787387825.859700:0:6629:0:(genops.c:906:class_export_put()) final put ffff8d437aabc000/d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000020:00000080:2.0:1787387825.859828:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d437aabc000/d7138a1c-1444-4499-9235-7f89dd5ceb0b for lustre-OST0000 00000020:00000080:2.0:1787387825.859882:0:474:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d437aabd000 for lustre-OST0000 00010000:00010000:1.0:1787387826.526369:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387827.550063:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387827.809947:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709712256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387827.810017:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387827.810117:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709712256 00000100:00100000:0.0:1787387827.810124:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709712256 00000100:00100000:0.0:1787387827.810178:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787387827.810188:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709712256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387827.810222:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387827.810265:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709712256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387827.810272:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1787387827.810292:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787387827.810330:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4374488a80 x1874211709712256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387827.810349:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709712256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387827.823984:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709712384:0@lo:400:kworker.0 00000100:00100000:0.0:1787387827.824060:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387827.824098:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709712896:0@lo:400:kworker.0 00000100:00100000:0.0:1787387827.824123:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387827.824147:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387827.824152:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709712512:0@lo:400:kworker.0 00000100:00100000:0.0:1787387827.824171:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387827.824200:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709712384 00000100:00100000:0.0:1787387827.824208:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709712384 00000100:00100000:0.0:1787387827.825007:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787387827.825017:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709712384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387827.825075:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709712384:12345-0@lo:400:kworker.0 Request processed in 59us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387827.825082:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787387827.825125:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709712896 00000100:00100000:0.0:1787387827.825130:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709712896 00000100:00100000:0.0:1787387827.825158:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709712512 00000100:00100000:0.0:1787387827.825160:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709712512 00000100:00100000:0.0:1787387827.825175:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787387827.825181:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709712896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387827.825430:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787387827.825440:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709712512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387827.825474:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709712512:12345-0@lo:400:kworker.0 Request processed in 37us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387827.825479:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787387827.825501:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709712640:0@lo:400:kworker.0 00000100:00100000:1.0:1787387827.825530:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387827.825551:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387827.825557:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437448ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709712768:0@lo:400:kworker.0 00000100:00100000:1.0:1787387827.825577:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387827.825600:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709712640 00000100:00100000:1.0:1787387827.825603:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709712640 00000100:00100000:1.0:1787387827.825623:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787387827.825629:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709712640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387827.825661:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709712640:12345-0@lo:400:kworker.0 Request processed in 31us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387827.825677:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787387827.825696:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709712768 00000100:00100000:1.0:1787387827.825699:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709712768 00000100:00100000:1.0:1787387827.825724:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787387827.825729:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709712768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387827.826341:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709712896:12345-0@lo:400:kworker.0 Request processed in 1156us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387827.826349:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787387827.826395:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709712512:0@lo:400:kworker.0 00000100:00100000:0.0:1787387827.826408:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709712384:0@lo:400:kworker.0 00000100:00100000:0.0:1787387827.826418:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709712896:0@lo:400:kworker.0 00000100:00080000:0.0:1787387827.826457:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787387827.826461:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387827.826582:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709712768:12345-0@lo:400:kworker.0 Request processed in 851us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387827.826590:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787387827.826619:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437448ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709712768:0@lo:400:kworker.0 00000100:00100000:1.0:1787387827.826628:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709712640:0@lo:400:kworker.0 00010000:00010000:0.0:1787387828.581983:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787387828.768277:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787387828.830065:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709713024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387828.830136:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387828.830538:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709713024 00000100:00100000:2.0:1787387828.830559:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709713024 00000100:00100000:2.0:1787387828.830628:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787387828.830638:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709713024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387828.830686:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387828.830774:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709713024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387828.830780:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787387828.830859:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709713024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787387829.600939:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387829.682529:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387829.682585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387829.682620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387829.682826:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690800640 00000100:00100000:1.0:1787387829.682837:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690800640 00000100:00100000:1.0:1787387829.682915:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690800768 00000100:00100000:1.0:1787387829.682918:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690800768 00000100:00100000:1.0:1787387829.682953:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00100000:1.0:1787387829.682964:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690800640:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387829.683057:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690800640:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 94us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387829.683065:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00100000:1.0:1787387829.683085:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:1.0:1787387829.683092:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690800768:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387829.683131:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690800768:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 39us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387829.683137:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:0.0:1787387829.683954:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690800512 00000100:00100000:0.0:1787387829.683961:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690800512 00000100:00100000:0.0:1787387829.684009:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 289 00000100:00100000:0.0:1787387829.684023:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690800512:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387829.684066:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690800512:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 50us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387829.684072:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 289 00000100:00080000:3.0:1787387829.684494:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787387830.623322:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787387830.691285:0:11721:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:37:09 (1787387829) 00010000:00010000:0.0:1787387831.645998:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387832.635142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387832.635236:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690800896 00000100:00100000:1.0:1787387832.635247:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690800896 00000100:00100000:1.0:1787387832.635319:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:1.0:1787387832.635330:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:10214:x1874211690800896:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787387832.635350:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387832.635416:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c78ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52841 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.635479:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c78b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.635493:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c78b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.635505:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c78b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387832.635701:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787387832.635705:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787387832.635824:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c78b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.635851:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c78ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52841 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.635869:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c78b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52841 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.635884:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720700) 00010000:00010000:1.0:1787387832.635887:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787387832.635891:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5000, rc 0) 00000100:00100000:1.0:1787387832.635956:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:10214:x1874211690800896:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 628us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387832.635963:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00080000:3.0:1787387832.636024:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387832.645538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387832.645640:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690801024 00000100:00100000:2.0:1787387832.645650:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690801024 00000100:00100000:2.0:1787387832.645713:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:2.0:1787387832.645723:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:10215:x1874211690801024:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787387832.645774:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387832.645794:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c78ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.645855:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c78c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.645867:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c78c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.645878:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c78c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.645892:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c78c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.645899:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c78c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.645923:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c78c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646596:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c78cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646609:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c78cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646618:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c78cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387832.646785:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787387832.646789:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787387832.646862:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c78cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646874:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c78c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646881:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c78c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646888:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c78c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646894:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387832.646897:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c78c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646905:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c78c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646922:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720700) 00010000:00010000:2.0:1787387832.646925:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387832.646930:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c78c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646936:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c78c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646948:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c78c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646953:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c78c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646959:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c78c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646965:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387832.646967:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c78c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646973:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c78c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646980:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d436f2f6000) 00010000:00010000:2.0:1787387832.646983:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387832.646985:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c78c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.646991:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c78c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.647032:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c78ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52848 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.647046:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c78cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52848 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387832.647053:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d436f2f6f00) 00010000:00010000:2.0:1787387832.647055:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787387832.647058:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90c00, rc 0) 00000100:00100000:2.0:1787387832.647179:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:10215:x1874211690801024:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1456us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387832.647188:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:2.0:1787387832.669705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387832.669877:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690801280 00000100:00100000:1.0:1787387832.669887:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690801280 00000100:00100000:1.0:1787387832.669943:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:1.0:1787387832.669952:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:10215:x1874211690801280:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787387832.669972:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387832.669990:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c78d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5284f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670058:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c78dd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670072:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c78dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670083:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c78dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670139:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c78e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670147:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c78e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670166:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c78e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670659:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5a00/0x93d41aeaa23c78eb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670683:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5a00/0x93d41aeaa23c78eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670690:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5a00/0x93d41aeaa23c78eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387832.670702:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787387832.670917:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c78dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670925:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c78dd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670931:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c78dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670938:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387832.670942:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c78dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670950:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c78dd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670961:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d436f2f6f00) 00010000:00010000:1.0:1787387832.670964:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387832.670974:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c78dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670981:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c78dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670992:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c78e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.670998:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c78e4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.671003:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c78e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.671008:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387832.671011:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c78e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.671016:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c78e4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.671024:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d4358720e00) 00010000:00010000:1.0:1787387832.671026:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387832.671029:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c78e4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.671034:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c78e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.671469:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c78d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5284f expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.671495:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5a00/0x93d41aeaa23c78eb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5284f expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387832.671503:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:1.0:1787387832.671505:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387832.671507:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5a00, rc 0) 00000100:00100000:1.0:1787387832.671583:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:10215:x1874211690801280:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1631us (1888us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787387832.671592:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00010000:00010000:2.0:1787387832.677465:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387832.684981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387832.685567:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690801408 00000100:00100000:2.0:1787387832.685578:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690801408 00000100:00100000:2.0:1787387832.685642:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:2.0:1787387832.685653:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:10215:x1874211690801408:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787387832.685832:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:10215:x1874211690801408:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 180us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387832.685840:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000040:00080000:3.0:1787387832.875107:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787387832.926400:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709713152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387832.926475:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387832.926572:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709713152 00000100:00100000:0.0:1787387832.926580:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709713152 00000100:00100000:0.0:1787387832.926637:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787387832.926646:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709713152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387832.926695:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387832.926765:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709713152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387832.926772:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1787387832.926791:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787387832.926822:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4374489f80 x1874211709713152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387832.926839:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709713152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387832.927977:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709713408:0@lo:400:kworker.0 00000100:00100000:1.0:1787387832.928028:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387832.928057:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387832.928063:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709713536:0@lo:400:kworker.0 00000100:00100000:1.0:1787387832.928086:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387832.928129:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709713408 00000100:00100000:1.0:1787387832.928135:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709713408 00000100:00100000:1.0:1787387832.928176:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709713536 00000100:00100000:1.0:1787387832.928180:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709713536 00000100:00100000:1.0:1787387832.928201:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787387832.928208:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709713408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387832.928261:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709713408:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387832.928268:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787387832.928283:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787387832.928289:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709713536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387832.928344:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709713536:12345-0@lo:400:kworker.0 Request processed in 55us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387832.928351:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787387832.928384:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709713536:0@lo:400:kworker.0 00000100:00100000:1.0:1787387832.928394:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709713408:0@lo:400:kworker.0 00000100:00100000:2.0:1787387832.928464:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709713664:0@lo:400:kworker.0 00000100:00100000:2.0:1787387832.928495:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387832.928523:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787387832.928529:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709713280:0@lo:400:kworker.0 00000100:00100000:2.0:1787387832.928578:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387832.928604:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709713792:0@lo:400:kworker.0 00000100:00100000:2.0:1787387832.928624:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387832.928649:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709713280 00000100:00100000:2.0:1787387832.928653:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709713280 00000100:00100000:2.0:1787387832.928695:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787387832.928702:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709713280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387832.928762:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709713280:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387832.928770:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787387832.928808:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709713280:0@lo:400:kworker.0 00000100:00100000:2.0:1787387832.928824:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709713792 00000100:00100000:2.0:1787387832.928827:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709713792 00000100:00100000:2.0:1787387832.928851:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787387832.928856:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709713792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387832.928888:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709713792:12345-0@lo:400:kworker.0 Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387832.928894:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787387832.928921:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709713792:0@lo:400:kworker.0 00000100:00080000:0.0:1787387832.934418:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387832.937050:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709713664 00000100:00100000:1.0:1787387832.937064:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709713664 00000100:00080000:0.0:1787387832.943921:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387832.946374:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787387832.946397:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709713664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387832.946561:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709713664:12345-0@lo:400:kworker.0 Request processed in 175us (18065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387832.946569:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787387832.956884:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709713664:0@lo:400:kworker.0 00010000:00010000:2.0:1787387833.694011:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387833.959293:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387833.966333:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709713920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387833.966410:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387833.966692:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709713920 00000100:00100000:2.0:1787387833.966701:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709713920 00000100:00100000:2.0:1787387833.966791:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787387833.966800:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709713920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387833.966837:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387833.966904:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709713920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387833.966910:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787387833.968276:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709713920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387834.718121:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387834.797206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387834.797248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387834.797274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387834.797301:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690801664 00000100:00100000:3.0:1787387834.797310:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690801664 00000100:00100000:3.0:1787387834.797364:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690801792 00000100:00100000:3.0:1787387834.797367:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690801792 00000100:00100000:3.0:1787387834.797393:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:3.0:1787387834.797403:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2352:x1874211690801664:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387834.797477:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2352:x1874211690801664:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 76us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387834.797485:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:3.0:1787387834.797504:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:3.0:1787387834.797510:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690801792:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387834.797535:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690801792:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387834.797541:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:3.0:1787387834.797558:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690801536 00000100:00100000:3.0:1787387834.797568:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690801536 00000100:00100000:3.0:1787387834.797594:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 291 00000100:00100000:3.0:1787387834.797601:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690801536:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387834.797627:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690801536:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387834.797633:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 291 00000100:00080000:3.0:1787387834.797662:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387835.239345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387835.239533:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690801920 00000100:00100000:3.0:1787387835.239544:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690801920 00000100:00100000:3.0:1787387835.239610:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:3.0:1787387835.239631:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:10257:x1874211690801920:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387835.239652:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387835.239674:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c78f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52856 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.239760:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7900 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.239773:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.239784:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.239800:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7907 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.239807:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.239829:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240114:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240121:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7900 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240127:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7900 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240132:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387835.240137:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7900 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240144:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7900 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240156:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720700) 00010000:00010000:3.0:1787387835.240158:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387835.240162:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7900 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240168:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7900 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240189:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240194:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7907 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240205:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7907 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240211:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387835.240213:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7907 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240220:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7907 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240228:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d4343c2d900) 00010000:00010000:3.0:1787387835.240231:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387835.240234:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7907 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240239:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7907 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240271:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c78f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52856 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240280:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720700) 00010000:00010000:3.0:1787387835.240282:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387835.240285:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c78f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52856 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.240294:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f600, rc 0) 00000100:00100000:3.0:1787387835.240355:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:10257:x1874211690801920:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 727us (1019us total) trans 0 rc 301/301 00000100:00100000:3.0:1787387835.240370:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:3.0:1787387835.246923:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387835.247045:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690802176 00000100:00100000:0.0:1787387835.247055:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690802176 00000100:00100000:0.0:1787387835.247228:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:0.0:1787387835.247238:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:10257:x1874211690802176:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:0.0:1787387835.247293:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387835.247320:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c78b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52841 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.247348:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720700) 00010000:00010000:0.0:1787387835.247359:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387835.248050:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c790e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.248065:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c790e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.248371:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c790e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.248386:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7915 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.248394:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7915 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.248412:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7915 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387835.249463:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787387835.249478:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c790e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.249487:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c790e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.249493:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c790e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.249499:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387835.249510:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c790e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.249517:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c790e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.249530:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c46200) 00010000:00010000:0.0:1787387835.249533:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387835.249536:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c790e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.249543:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c790e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787387835.249562:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3e61fe4 reply state 00000000d8fc28ae transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7915 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387835.249571:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387835.249691:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:10257:x1874211690802176:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 2451us (2774us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787387835.249701:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00010000:00010000:1.0:1787387835.257044:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7915 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.257064:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7915 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.257084:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7915 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.257090:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387835.257096:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7915 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.257111:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7915 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.257155:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d4343c46c00) 00010000:00010000:1.0:1787387835.257158:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387835.257163:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7915 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.257184:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7915 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387835.381000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387835.381185:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690802304 00000100:00100000:3.0:1787387835.381196:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690802304 00000100:00100000:3.0:1787387835.381289:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1787387835.381299:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:10265:x1874211690802304:12345-192.168.204.59@tcp:101:lctl.0 00010000:00010000:3.0:1787387835.381324:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387835.381346:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c791c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5285d expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.381422:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7923 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.381435:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.381445:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387835.385364:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787387835.385376:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387835.385456:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.385501:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c791c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5285d expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.385526:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5285d expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.385550:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:3.0:1787387835.385554:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387835.385558:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e000, rc 0) 00000100:00100000:3.0:1787387835.385636:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:10265:x1874211690802304:12345-192.168.204.59@tcp:101:lctl.0 Request processed in 4337us (4648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387835.385645:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1787387835.473149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387835.473384:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690802432 00000100:00100000:0.0:1787387835.473404:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690802432 00000100:00100000:0.0:1787387835.473465:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:0.0:1787387835.473475:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:10271:x1874211690802432:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1787387835.473496:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387835.473517:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c792a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52864 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473584:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7931 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473609:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473620:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473650:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7938 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473658:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473665:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473823:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c793f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473831:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c793f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473839:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c793f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387835.473872:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787387835.473876:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387835.473916:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c793f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473929:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473946:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7931 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473953:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7931 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473959:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387835.473963:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7931 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473971:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7931 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473984:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:0.0:1787387835.473987:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387835.473992:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7931 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.473997:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7931 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.474012:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.474018:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7938 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.474024:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7938 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.474028:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387835.474038:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7938 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.474044:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7938 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.474052:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d4343c46200) 00010000:00010000:0.0:1787387835.474055:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387835.474057:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7938 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.474062:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7938 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.474108:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c792a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52864 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.474120:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c793f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52864 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.474128:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:0.0:1787387835.474130:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787387835.474133:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71200, rc 0) 00000100:00100000:0.0:1787387835.474211:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:10271:x1874211690802432:12345-192.168.204.59@tcp:101:bash.0 Request processed in 737us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387835.474218:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:0.0:1787387835.476696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387835.478569:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690802688 00000100:00100000:2.0:1787387835.478583:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690802688 00000100:00100000:3.0:1787387835.483658:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:3.0:1787387835.483676:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:10271:x1874211690802688:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1787387835.483699:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387835.483722:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7946 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5286b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.483888:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c794d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.483903:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c794d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.483915:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c794d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.483994:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7954 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.484003:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.484027:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787387835.487871:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787387835.488267:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c795b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.488285:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c795b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.488299:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c795b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.488342:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c794d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.488350:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c794d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.488357:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c794d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.488363:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387835.488368:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c794d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.488375:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c794d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.488926:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387835.488930:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387835.488944:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c794d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.488952:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c794d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787387835.488969:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005701db7b reply state 000000001a78d8c9 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387835.488978:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787387835.489021:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7946 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5286b expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.489037:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c795b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5286b expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.489045:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d100) 00010000:00010000:3.0:1787387835.489047:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387835.489050:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152fc00, rc 0) 00000100:00100000:3.0:1787387835.489290:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:10271:x1874211690802688:12345-192.168.204.59@tcp:101:bash.0 Request processed in 5618us (12604us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787387835.489300:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:2.0:1787387835.505018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387835.506520:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690802816 00000100:00100000:1.0:1787387835.506533:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690802816 00000100:00100000:1.0:1787387835.506593:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1787387835.506601:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874211690802816:12345-192.168.204.59@tcp:8:bash.0 00010000:00080000:1.0:1787387835.506645:0:6606:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:1.0:1787387835.506680:0:6606:0:(genops.c:1406:class_connect()) connect: client d7138a1c-1444-4499-9235-7f89dd5ceb0b, cookie 0x93d41aeaa23c7969 00002000:00100000:1.0:1787387835.506694:0:6606:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d7138a1c-1444-4499-9235-7f89dd5ceb0b/ffff8d437a71e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787387835.506720:0:6606:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:1.0:1787387835.506986:0:6606:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787387835.507016:0:6606:0:(import.c:65:import_set_state_nolock()) ffff8d437a71b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387835.507091:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2349:x1874211690802816:12345-192.168.204.59@tcp:8:bash.0 Request processed in 488us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387835.507099:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00010000:00010000:3.0:1787387835.510466:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.510484:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7954 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.510491:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7954 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.510517:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387835.510522:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7954 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.510531:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7954 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.510548:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c2d800) 00010000:00010000:3.0:1787387835.510552:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387835.510557:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7954 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.510564:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7954 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387835.511815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387835.512753:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690802944 00000100:00100000:3.0:1787387835.512765:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690802944 00000100:00100000:3.0:1787387835.512841:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1787387835.512853:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:0:x1874211690802944:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1787387835.512873:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387835.512898:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000439be306/0x93d41aeaa23c7970 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52872 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787387835.512926:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387835.512946:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1787387835.512951:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387835.512961:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000439be306/0x93d41aeaa23c7970 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52872 expref: 7 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.512999:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000439be306/0x93d41aeaa23c7970 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52872 expref: 7 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.513013:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f600, rc 0) 00000100:00100000:3.0:1787387835.513088:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:0:x1874211690802944:12345-192.168.204.59@tcp:101:bash.0 Request processed in 238us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387835.513096:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00080000:0.0:1787387835.513941:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387835.516801:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387835.516890:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690803072 00000100:00100000:1.0:1787387835.516901:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690803072 00000100:00100000:1.0:1787387835.516957:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:1.0:1787387835.516968:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:10271:x1874211690803072:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1787387835.516986:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387835.517012:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52879 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.517043:0:6606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000439be306/0x93d41aeaa23c7970 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52872 expref: 8 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.517051:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387835.517055:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387835.517060:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 8 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.517106:0:6606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000439be306/0x93d41aeaa23c7970 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52872 expref: 8 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.517120:0:6606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000439be306/0x93d41aeaa23c7970 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52872 expref: 8 pid: 6605 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387835.517134:0:6606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6606:1874211709714048:192.168.204.59@tcp:104: 00000100:00100000:1.0:1787387835.517234:0:6606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43412540c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387835.528002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387835.528139:0:6606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6606:1874211709714048:192.168.204.59@tcp:104: 00010000:00010000:1.0:1787387835.528184:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 8 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.528206:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4c00, rc 0) 00000100:00100000:1.0:1787387835.528273:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:10271:x1874211690803072:12345-192.168.204.59@tcp:101:bash.0 Request processed in 11306us (11481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387835.528300:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:0.0:1787387835.528714:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690803200 00000100:00100000:0.0:1787387835.528722:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690803200 00010000:00010000:0.0:1787387835.528790:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000439be306/0x93d41aeaa23c7970 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52872 expref: 8 pid: 6605 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387835.528819:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:0.0:1787387835.528828:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690803200:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387835.528840:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387835.528862:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000439be306/0x93d41aeaa23c7970 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52872 expref: 8 pid: 6605 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.528874:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000439be306/0x93d41aeaa23c7970 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52872 expref: 8 pid: 6605 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.528899:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000439be306/0x93d41aeaa23c7970 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52872 expref: 8 pid: 6605 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.528914:0:8324:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387835.528919:0:8324:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387835.528926:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.528936:0:8324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.528970:0:8324:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387835.528992:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437448ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8324:1874211709714176:192.168.204.59@tcp:105: 00000100:00100000:0.0:1787387835.529071:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4345c0b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787387835.535489:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437448ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8324:1874211709714176:192.168.204.59@tcp:105: 00010000:00010000:0.0:1787387835.535517:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387835.535570:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690803200:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 6742us (7576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387835.535581:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:2.0:1787387835.537516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387835.540724:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690803456 00000100:00100000:0.0:1787387835.540757:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690803456 00000100:00100000:0.0:1787387835.540901:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1787387835.540912:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:10271:x1874211690803456:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:0.0:1787387835.541305:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:10271:x1874211690803456:12345-192.168.204.59@tcp:35:bash.0 Request processed in 394us (3795us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787387835.541316:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:3.0:1787387835.692613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387835.692765:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690803712 00000100:00100000:0.0:1787387835.692775:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690803712 00000100:00100000:0.0:1787387835.692833:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:0.0:1787387835.692844:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:10281:x1874211690803712:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387835.692870:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387835.692901:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c797e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52880 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387835.693016:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787387835.693143:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c797e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52880 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.693175:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:0.0:1787387835.693178:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787387835.693184:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c797e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52880 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.693199:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71000, rc 0) 00000100:00100000:0.0:1787387835.693264:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:10281:x1874211690803712:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 421us (659us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787387835.693272:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:3.0:1787387835.697709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387835.698273:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690803968 00000100:00100000:2.0:1787387835.698284:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690803968 00000100:00100000:2.0:1787387835.698342:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1787387835.698353:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:10281:x1874211690803968:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1787387835.698643:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:10281:x1874211690803968:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 291us (942us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787387835.698651:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00010000:00010000:2.0:1787387835.741945:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387835.841068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387835.843600:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690804096 00000100:00100000:0.0:1787387835.843619:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690804096 00000100:00100000:0.0:1787387835.843852:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:0.0:1787387835.843864:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:10287:x1874211690804096:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387835.844032:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387835.844054:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c798c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52887 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.844250:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7993 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.844265:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.844276:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387835.844336:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787387835.844353:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387835.844379:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.844404:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c798c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52887 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.844424:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52887 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.844433:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:0.0:1787387835.844436:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787387835.844440:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71a00, rc 0) 00000100:00100000:0.0:1787387835.844525:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:10287:x1874211690804096:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 662us (3477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387835.844532:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:3.0:1787387835.850696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387835.850940:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690804352 00000100:00100000:0.0:1787387835.850951:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690804352 00000100:00100000:0.0:1787387835.851014:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:0.0:1787387835.851023:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:10287:x1874211690804352:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387835.851043:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387835.851063:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c799a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5288e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.851170:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c79a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.851184:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c79a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.851213:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c79a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387835.851226:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787387835.851359:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c799a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5288e expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.851375:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c79a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5288e expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.851383:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d100) 00010000:00010000:0.0:1787387835.851386:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387835.851390:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71400, rc 0) 00000100:00100000:0.0:1787387835.851453:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:10287:x1874211690804352:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 431us (766us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787387835.851461:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1787387835.854685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387835.854871:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690804480 00000100:00100000:1.0:1787387835.854881:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690804480 00000100:00100000:1.0:1787387835.854933:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:1.0:1787387835.854942:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:2352:x1874211690804480:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787387835.854957:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387835.854979:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c79a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5288e expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.854998:0:11042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d100) 00010000:00010000:1.0:1787387835.855002:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387835.855064:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:2352:x1874211690804480:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 115us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387835.855072:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:2.0:1787387835.860983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387835.861424:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690804736 00000100:00100000:3.0:1787387835.861434:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690804736 00000100:00100000:3.0:1787387835.861531:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:3.0:1787387835.861541:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10287:x1874211690804736:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387835.861565:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387835.861586:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c79af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52895 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.861684:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.861710:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.861722:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387835.861784:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787387835.861902:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c79af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52895 expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.861920:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52895 expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.861928:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d100) 00010000:00010000:3.0:1787387835.861931:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787387835.861934:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e800, rc 0) 00000100:00100000:3.0:1787387835.861983:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:10287:x1874211690804736:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 443us (1009us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787387835.861990:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:3.0:1787387835.874279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387835.874721:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690804864 00000100:00100000:1.0:1787387835.874733:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690804864 00000100:00100000:1.0:1787387835.874833:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:1.0:1787387835.874844:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690804864:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:1.0:1787387835.874891:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.874912:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.874921:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787387835.874925:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787387835.874943:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.874978:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.874993:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 7 pid: 6606 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387835.875009:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6605:1874211709714304:192.168.204.59@tcp:104: 00000100:00100000:1.0:1787387835.875871:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43412540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387835.882268:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6605:1874211709714304:192.168.204.59@tcp:104: 00010000:00010000:1.0:1787387835.882295:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387835.886037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387835.886193:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690804992 00000100:00100000:2.0:1787387835.886203:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690804992 00002000:00100000:2.0:1787387835.886247:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d4346459500 x1874211690804992/t0(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:91/0 lens 504/0 e 0 to 0 dl 1787387846 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787387835.886259:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4346459500 with x1874211690804992 ext(0->12) 00010000:00010000:2.0:1787387835.886268:0:6609:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 8 pid: 6606 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387835.886303:0:6609:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 8 pid: 6606 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787387835.886312:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4346459500 00000100:00100000:2.0:1787387835.886348:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:2.0:1787387835.886357:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690804992:12345-192.168.204.59@tcp:4:lfs.0 00000001:00100000:2.0:1787387835.913717:0:7514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000100:00100000:2.0:1787387835.914443:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2350:x1874211690804992:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 28080us (28408us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787387835.914460:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00002000:00100000:2.0:1787387835.914472:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d4346459500 x1874211690804992/t4294967299(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:91/0 lens 504/448 e 0 to 0 dl 1787387846 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787387835.914483:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4346459500 with x1874211690804992 ext(0->12) 00010000:00010000:2.0:1787387835.914501:0:6609:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 9 pid: 6606 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387835.914522:0:6609:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 9 pid: 6606 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787387835.914531:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4346459500 00000100:00100000:2.0:1787387835.925662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387835.925811:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690805120 00000100:00100000:0.0:1787387835.925821:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690805120 00010000:00010000:0.0:1787387835.925862:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 9 pid: 6606 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387835.925899:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:0.0:1787387835.925912:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2351:x1874211690805120:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387835.925925:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787387835.925943:0:5794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787387835.925945:0:5794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787387835 00002000:00010000:0.0:1787387835.925960:0:5794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787387836 00002000:00010000:0.0:1787387835.925962:0:5794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787387835 00010000:00010000:0.0:1787387835.925969:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 9 pid: 6606 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.925984:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 9 pid: 6606 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.926010:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cab1e3ac/0x93d41aeaa23c7977 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52879 expref: 9 pid: 6606 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.926029:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787387835.926034:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787387835.926040:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.926050:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.927502:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387835.927584:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2351:x1874211690805120:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1667us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387835.927596:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00010000:00010000:3.0:1787387835.927716:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.927731:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.927785:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.927795:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.927820:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.927828:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4a00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387835.927833:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.927842:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.927858:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.927865:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acb93e4f/0x93d41aeaa23c79c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387835.927931:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690804864:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 53089us (53660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387835.927940:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:2.0:1787387835.930694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387835.930793:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690805376 00000100:00100000:0.0:1787387835.930803:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690805376 00000100:00100000:0.0:1787387835.930850:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:0.0:1787387835.930859:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:10287:x1874211690805376:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:0.0:1787387835.930917:0:5810:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52895 expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387835.931320:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787387835.931380:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787387835.932030:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787387835.932108:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.932126:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c795b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5286b expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.932136:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.932188:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c795b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5286b expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387835.932203:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c795b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5286b expref: 24 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387835.932216:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437448ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1874211709714432:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387835.933446:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43438de0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387835.935914:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387835.936005:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690805504 00000100:00100000:1.0:1787387835.936014:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690805504 00010000:00010000:1.0:1787387835.936055:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c795b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5286b expref: 25 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387835.936098:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:1.0:1787387835.936109:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+25:2350:x1874211690805504:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787387835.936139:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387835.936146:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c795b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5286b expref: 25 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.936181:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c795b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5286b expref: 25 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.936203:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d100) 00010000:00010000:1.0:1787387835.936208:0:8324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.936216:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.936224:0:8324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387835.936243:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387835.936301:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+25:2350:x1874211690805504:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 193us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387835.936308:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00010000:00010000:2.0:1787387835.936980:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c795b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5286b expref: 24 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387835.937007:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437448ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1874211709714432:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387835.937029:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387835.937039:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387835.937045:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787387835.937399:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787387835.938471:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787387835.938649:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1874211709714560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787387835.938708:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387835.938768:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43452e4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787387835.939418:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709714560 00000100:00100000:1.0:1787387835.939427:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709714560 00000100:00100000:1.0:1787387835.939494:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387835.939502:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1874211709714560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787387835.939591:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1874211709714560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387835.939598:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787387835.939691:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387835.939968:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1874211709714560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787387835.941003:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787387835.943005:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1874211709714688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787387835.943124:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387835.943352:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709714688 00000100:00100000:1.0:1787387835.943360:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709714688 00000100:00100000:1.0:1787387835.943419:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387835.943428:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1874211709714688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787387835.943910:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5810:x1874211709714688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 481us (785us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787387835.943918:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787387835.944144:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4345c0b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787387835.944186:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1874211709714688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787387835.944253:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787387835.944296:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387835.944306:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387835.944328:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387835.944335:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387835.944339:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387835.944348:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387835.944366:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d100) 00010000:00010000:2.0:1787387835.944369:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787387835.944374:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387835.944381:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c79cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787387835.944561:0:5810:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787387835.945329:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787387835.945343:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340394603656ns, next at 341394600318ns, rc = 0 00000001:00080000:2.0:1787387835.945351:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787387835.945395:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d100) 00010000:00010000:2.0:1787387835.945398:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787387835.945406:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52895 expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387835.945593:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:10287:x1874211690805376:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 14733us (14905us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787387835.946165:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000020:00080000:2.0:1787387835.946171:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787387835.948487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387835.948560:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690805632 00000100:00100000:3.0:1787387835.948570:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690805632 00000100:00100000:3.0:1787387835.948634:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:3.0:1787387835.948644:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:10287:x1874211690805632:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387835.948665:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387835.948696:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c79d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5289c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.948862:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c79d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5289c expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.948877:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c79d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5289c expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387835.948896:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387835.948899:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787387835.948903:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e600, rc 0) 00000100:00100000:3.0:1787387835.948991:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:10287:x1874211690805632:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 348us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387835.948998:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:1.0:1787387835.952541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387835.952624:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690805888 00000100:00100000:2.0:1787387835.952635:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690805888 00000100:00100000:2.0:1787387835.952690:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:2.0:1787387835.952700:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d436567cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:10287:x1874211690805888:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1787387835.952942:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d436567cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:10287:x1874211690805888:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 243us (411us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787387835.952950:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1787387836.024356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387836.024780:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690806144 00000100:00100000:0.0:1787387836.024790:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690806144 00000100:00100000:0.0:1787387836.024863:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:0.0:1787387836.024883:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:10298:x1874211690806144:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387836.024907:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387836.024928:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c79d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528a3 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787387836.025167:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787387836.025212:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787387836.026795:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c79d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528a3 expref: 31 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387836.026813:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:0.0:1787387836.026816:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787387836.026821:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c79d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528a3 expref: 31 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387836.026845:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70200, rc 0) 00000100:00100000:0.0:1787387836.026926:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:10298:x1874211690806144:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 2052us (2579us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787387836.026936:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:1.0:1787387836.031999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387836.032187:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690806272 00000100:00100000:3.0:1787387836.032198:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690806272 00000100:00100000:3.0:1787387836.032289:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:3.0:1787387836.032300:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:10298:x1874211690806272:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:3.0:1787387836.032532:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c79e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.032551:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c79e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.032563:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c79e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.032598:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c79ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.032606:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c79ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.032614:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c79ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033007:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033018:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033026:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787387836.033072:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033087:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c79e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033093:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c79e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033100:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c79e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033106:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152ee00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387836.033110:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c79e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033125:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c79e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033138:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387836.033141:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387836.033145:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c79e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033152:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c79e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033179:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c79ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033185:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c79ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033190:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c79ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033194:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387836.033197:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c79ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033203:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c79ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033209:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c2d200) 00010000:00010000:3.0:1787387836.033211:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387836.033213:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c79ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033228:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c79ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033243:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033248:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033253:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033257:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387836.033260:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033265:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033272:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387836.033273:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387836.033276:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.033281:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c79f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387836.033419:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:10298:x1874211690806272:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 1118us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387836.033428:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:1.0:1787387836.036258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387836.036289:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690806528 00000100:00100000:1.0:1787387836.036298:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690806528 00000100:00100000:1.0:1787387836.036350:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1787387836.036360:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:10298:x1874211690806528:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1787387836.037070:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+31:10298:x1874211690806528:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 710us (818us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787387836.037080:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000001:00080000:3.0:1787387836.040900:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967320 is committed 00000001:00080000:3.0:1787387836.040932:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000004:00080000:3.0:1787387836.040944:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787387836.040966:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d4345c0ba80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787387836.040971:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d4345c18e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d4345c0be40 00000020:00080000:3.0:1787387836.040974:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d4345c18500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d437ab54c00 00000100:00100000:3.0:1787387836.041441:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709714816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787387836.041512:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787387836.041679:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787387836.041798:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787387836.042543:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709714816 00000100:00100000:3.0:1787387836.042551:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709714816 00000100:00100000:3.0:1787387836.042696:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787387836.042705:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709714816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787387836.042733:0:6604:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1787387836.042791:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a895fbb, atime: 0x6a895fbc, ctime: 0x6a895fbb, blocks: 0x1 00010000:00010000:3.0:1787387836.042799:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bd1b2ad/0x93d41aeaa23c79fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.042816:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1787387836.042820:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387836.042826:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bd1b2ad/0x93d41aeaa23c79fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.042839:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bd1b2ad/0x93d41aeaa23c79fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.042850:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bd1b2ad/0x93d41aeaa23c79fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.042938:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bd1b2ad/0x93d41aeaa23c79fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.042959:0:6604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387836.043003:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387836.043013:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bd1b2ad/0x93d41aeaa23c79fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.043096:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e800 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387836.043101:0:11539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bd1b2ad/0x93d41aeaa23c79fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.043112:0:11539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bd1b2ad/0x93d41aeaa23c79fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.043132:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bd1b2ad/0x93d41aeaa23c79fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.043140:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bd1b2ad/0x93d41aeaa23c79fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.043194:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387836.043197:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387836.043199:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787387836.043711:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d437a2d9f80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787387836.043719:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709714816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787387836.043797:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874211709714816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1092us (2284us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787387836.043805:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787387836.089314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387836.091009:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690806784 00000100:00100000:3.0:1787387836.091026:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690806784 00000100:00100000:3.0:1787387836.091103:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1787387836.091114:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:10301:x1874211690806784:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387836.091139:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387836.091528:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7a03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.091625:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.091641:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.091653:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.091667:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.091673:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.091694:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.092275:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7a18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.092289:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7a18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.092297:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7a18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387836.092308:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787387836.093376:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093390:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093398:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093405:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152ee00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387836.093409:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093417:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093432:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:2.0:1787387836.093443:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387836.093449:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093466:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093481:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093487:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093494:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093499:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152fc00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387836.093502:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093517:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093526:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c2d800) 00010000:00010000:2.0:1787387836.093528:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387836.093531:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093536:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093592:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7a03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528aa expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093619:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7a18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528aa expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.093627:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:2.0:1787387836.093629:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787387836.093631:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90400, rc 0) 00000100:00100000:2.0:1787387836.093715:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:10301:x1874211690806784:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 2602us (4410us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787387836.093725:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:0.0:1787387836.098311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387836.098591:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690806912 00000100:00100000:1.0:1787387836.098695:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690806912 00000100:00100000:1.0:1787387836.098774:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:1.0:1787387836.098783:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:10301:x1874211690806912:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1787387836.098848:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7a26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.098974:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.098987:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.099014:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.099021:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7a26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.099028:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.099035:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387836.099039:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.099045:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7a26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.099112:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:1.0:1787387836.099116:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787387836.099120:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7a26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.099127:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7a26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387836.099729:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:10301:x1874211690806912:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 945us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387836.099837:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:1.0:1787387836.112097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387836.113174:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690807168 00000100:00100000:2.0:1787387836.113218:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690807168 00000100:00100000:2.0:1787387836.113489:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1787387836.113633:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:10301:x1874211690807168:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1787387836.115112:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:10301:x1874211690807168:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 1603us (3015us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787387836.115124:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1787387836.372294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387836.373414:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690807424 00000100:00100000:3.0:1787387836.373430:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690807424 00000100:00100000:3.0:1787387836.373513:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:3.0:1787387836.373523:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:10332:x1874211690807424:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:3.0:1787387836.373548:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387836.373571:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528b1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.373675:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7a34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.373690:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.373702:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387836.373712:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787387836.374130:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b1 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.374162:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7a34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b1 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.374172:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387836.374180:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387836.374184:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f400, rc 0) 00000100:00100000:3.0:1787387836.374858:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10332:x1874211690807424:12345-192.168.204.59@tcp:101:cat.0 Request processed in 1334us (2572us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787387836.374866:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:0.0:1787387836.382207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387836.382272:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690807552 00000100:00100000:2.0:1787387836.382281:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690807552 00000100:00100000:0.0:1787387836.382299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387836.382349:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:2.0:1787387836.382359:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:2350:x1874211690807552:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387836.382373:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387836.382399:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7a34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b1 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.382418:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:2.0:1787387836.382435:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387836.382492:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:2350:x1874211690807552:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 134us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387836.382500:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1787387836.382578:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690807808 00000100:00100000:1.0:1787387836.382583:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690807808 00000100:00100000:1.0:1787387836.383252:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1787387836.383262:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:10332:x1874211690807808:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:1.0:1787387836.384344:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10332:x1874211690807808:12345-192.168.204.59@tcp:35:cat.0 Request processed in 1079us (2040us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787387836.384356:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:0.0:1787387836.424323:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387836.424472:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690808064 00000100:00100000:3.0:1787387836.424486:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690808064 00000100:00100000:3.0:1787387836.424564:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:3.0:1787387836.424575:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10338:x1874211690808064:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:3.0:1787387836.424599:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387836.424602:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787387836.424627:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7993 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52887 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.424646:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387836.424650:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387836.424664:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528b8 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.424806:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.424820:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7a18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528aa expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.424828:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.424858:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7a18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528aa expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.424881:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7a18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528aa expref: 18 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387836.424893:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4346458000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709714944:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387836.424979:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374241b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387836.430023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387836.430165:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690808192 00000100:00100000:1.0:1787387836.430182:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690808192 00010000:00010000:1.0:1787387836.430218:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7a18 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528aa expref: 19 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387836.430421:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:1.0:1787387836.430430:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:2351:x1874211690808192:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787387836.430444:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387836.430451:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7a18 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528aa expref: 19 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.430465:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7a18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528aa expref: 19 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.430487:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:1.0:1787387836.430492:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.430518:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.430527:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.430545:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387836.430604:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:2351:x1874211690808192:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 175us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387836.430612:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00010000:00010000:3.0:1787387836.431695:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7a18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528aa expref: 18 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387836.431715:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4346458000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709714944:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387836.431735:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.431878:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.431884:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387836.431903:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787387836.432059:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b8 expref: 19 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.432074:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b8 expref: 18 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.432082:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387836.432093:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787387836.432096:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152fc00, rc 0) 00000100:00100000:3.0:1787387836.432159:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10338:x1874211690808064:12345-192.168.204.59@tcp:101:dd.0 Request processed in 7574us (7833us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787387836.432168:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:2.0:1787387836.435841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387836.436004:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690808448 00000100:00100000:3.0:1787387836.436014:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690808448 00000100:00100000:3.0:1787387836.436064:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:3.0:1787387836.436072:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10338:x1874211690808448:12345-192.168.204.59@tcp:36:dd.0 00010000:00010000:3.0:1787387836.436349:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.436367:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.436379:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787387836.436423:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787387836.436450:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cba94e4e reply state 00000000c54aaec6 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387836.436459:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787387836.436594:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:10338:x1874211690808448:12345-192.168.204.59@tcp:36:dd.0 Request processed in 521us (761us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787387836.436601:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000020:00080000:3.0:1787387836.436606:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787387836.439769:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.439788:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.439796:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.439802:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152ee00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387836.439807:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.439815:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.439832:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:1.0:1787387836.439835:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387836.439839:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.439908:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387836.608002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387836.608190:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690808576 00000100:00100000:1.0:1787387836.608210:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690808576 00000100:00100000:1.0:1787387836.608272:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:1.0:1787387836.608281:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:10352:x1874211690808576:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:1.0:1787387836.608306:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387836.608327:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7a5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528bf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.608401:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7a65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.608415:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.608427:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.608440:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7a6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.608447:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.608454:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.608792:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.608810:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b8 expref: 21 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.608818:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.608853:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b8 expref: 21 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.608866:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b8 expref: 21 pid: 6840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387836.608880:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a082680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709715072:192.168.204.59@tcp:104: 00000100:00100000:1.0:1787387836.608972:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a3f0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787387836.611668:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a082680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709715072:192.168.204.59@tcp:104: 00010000:00010000:1.0:1787387836.611703:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387836.612458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387836.612533:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690808832 00000100:00100000:0.0:1787387836.612540:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690808832 00000100:00100000:0.0:1787387836.612601:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1787387836.612610:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:5566:x1874211690808832:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787387836.612970:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:5566:x1874211690808832:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 360us (513us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787387836.612994:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1787387836.617550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387836.617647:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690808960 00000100:00100000:1.0:1787387836.617657:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690808960 00010000:00010000:1.0:1787387836.617696:0:11042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b8 expref: 23 pid: 6840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387836.617769:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:1.0:1787387836.617779:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:2350:x1874211690808960:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787387836.617793:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387836.617812:0:11042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b8 expref: 23 pid: 6840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.617825:0:11042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b8 expref: 23 pid: 6840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.617847:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528b8 expref: 23 pid: 6840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.617863:0:11042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:1.0:1787387836.617868:0:11042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.617878:0:11042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.617886:0:11042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387836.617914:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387836.617963:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:2350:x1874211690808960:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 185us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387836.617971:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00010000:00010000:3.0:1787387836.618078:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618087:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387836.618137:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787387836.618140:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387836.618197:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618410:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618421:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618427:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7a65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618434:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7a65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618440:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387836.618444:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7a65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618451:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7a65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618461:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387836.618463:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387836.618466:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7a65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618472:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7a65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618495:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618501:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7a6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618507:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618512:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387836.618515:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618520:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7a6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618527:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4358720e00) 00010000:00010000:3.0:1787387836.618529:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387836.618532:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7a6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618537:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7a6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618571:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7a5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528bf expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618583:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528bf expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.618599:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387836.618602:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387836.618604:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5000, rc 0) 00000100:00100000:3.0:1787387836.618632:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:10352:x1874211690808576:12345-192.168.204.59@tcp:101:stat.0 Request processed in 10353us (10641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387836.618639:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:2.0:1787387836.693649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387836.694243:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690809216 00000100:00100000:3.0:1787387836.694254:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690809216 00000100:00100000:3.0:1787387836.694312:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:3.0:1787387836.694322:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:10358:x1874211690809216:12345-192.168.204.59@tcp:36:truncate.0 00010000:00010000:3.0:1787387836.694374:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387836.694401:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7a73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528bf expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.694431:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387836.694436:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387836.694645:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.694658:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.694668:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787387836.694712:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787387836.694734:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019cbb3d6 reply state 000000000e6ab745 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387836.694804:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787387836.694920:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:10358:x1874211690809216:12345-192.168.204.59@tcp:36:truncate.0 Request processed in 598us (1278us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787387836.694928:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00000020:00080000:3.0:1787387836.694933:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787387836.698878:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.698898:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.698906:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.698914:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387836.698918:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.698927:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.698945:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:2.0:1787387836.698948:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387836.698953:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387836.698959:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387836.766478:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387836.933866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387836.934114:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690809344 00000100:00100000:3.0:1787387836.934127:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690809344 00000100:00100000:3.0:1787387836.934214:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:3.0:1787387836.934225:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:10372:x1874211690809344:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:3.0:1787387836.934260:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387836.934294:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7a81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528c6 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.934387:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.934405:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.934418:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.934436:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.934552:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.934560:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.937783:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.937814:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.937829:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387836.937896:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787387836.937901:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387836.937928:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.937943:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.937954:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.937960:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.937967:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.937973:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387836.937977:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.937984:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.938017:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387836.938020:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387836.938026:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.938033:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7a88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.938068:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.938075:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.938080:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.938085:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152fc00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387836.938089:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.942847:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.942871:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c2d100) 00010000:00010000:3.0:1787387836.942875:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387836.942880:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.942961:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7a8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.943052:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7a81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528c6 expref: 24 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.943068:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528c6 expref: 23 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387836.943075:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387836.943078:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387836.943080:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152ee00, rc 0) 00000100:00100000:3.0:1787387836.943173:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:10372:x1874211690809344:12345-192.168.204.59@tcp:101:stat.0 Request processed in 8949us (9321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387836.943183:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:0.0:1787387837.056995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387837.057532:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690809600 00000100:00100000:3.0:1787387837.057546:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690809600 00000100:00100000:3.0:1787387837.057623:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:3.0:1787387837.057634:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:10382:x1874211690809600:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387837.057668:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387837.057696:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7a9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528cd expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387837.058074:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787387837.058416:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7a9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528cd expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.058434:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:3.0:1787387837.058437:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787387837.058450:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7a9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528cd expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.058467:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e800, rc 0) 00000100:00100000:3.0:1787387837.058558:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:10382:x1874211690809600:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 924us (1578us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787387837.058566:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:1.0:1787387837.066802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387837.066896:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690809856 00000100:00100000:0.0:1787387837.066910:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690809856 00000100:00100000:0.0:1787387837.066983:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:0.0:1787387837.066995:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:10382:x1874211690809856:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1787387837.067620:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+25:10382:x1874211690809856:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 624us (830us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787387837.067630:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:1.0:1787387837.152925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387837.153589:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690810112 00000100:00100000:3.0:1787387837.153604:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690810112 00000100:00100000:3.0:1787387837.153693:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:3.0:1787387837.153704:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+25:10388:x1874211690810112:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1787387837.153736:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387837.153797:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7aab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528d4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.153942:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.153960:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528c6 expref: 26 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.153970:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.154011:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528c6 expref: 26 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.154027:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528c6 expref: 26 pid: 6840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387837.154350:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4346458000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709715200:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387837.154546:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374241900 going to sleep for 11 seconds 00000100:00100000:2.0:1787387837.165084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387837.165655:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690810240 00000100:00100000:0.0:1787387837.165670:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690810240 00010000:00010000:0.0:1787387837.165777:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528c6 expref: 27 pid: 6840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387837.165859:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:0.0:1787387837.165870:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:2350:x1874211690810240:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387837.165889:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387837.165898:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528c6 expref: 27 pid: 6840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.165915:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528c6 expref: 27 pid: 6840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.165945:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:0.0:1787387837.165969:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.165980:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.165989:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.166013:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387837.166102:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:2350:x1874211690810240:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 222us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387837.166110:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00010000:00010000:3.0:1787387837.167978:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7a96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528c6 expref: 26 pid: 6840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387837.168009:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4346458000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709715200:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387837.168051:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.168063:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.168069:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387837.168170:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787387837.168522:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7aab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528d4 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.168539:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528d4 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.168549:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387837.168553:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787387837.172329:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152fc00, rc 0) 00000100:00100000:3.0:1787387837.172577:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:10388:x1874211690810112:12345-192.168.204.59@tcp:101:bash.0 Request processed in 18866us (19658us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787387837.172609:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:2.0:1787387837.188455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387837.188988:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690810496 00000100:00100000:3.0:1787387837.189005:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690810496 00000100:00100000:3.0:1787387837.189102:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:3.0:1787387837.189115:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:10388:x1874211690810496:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:3.0:1787387837.189677:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7ac0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.189712:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.189726:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787387837.193651:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787387837.193918:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000529e5093 reply state 00000000054283b5 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387837.193934:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787387837.194116:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:10388:x1874211690810496:12345-192.168.204.59@tcp:36:bash.0 Request processed in 4998us (5670us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787387837.194128:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00000020:00080000:2.0:1787387837.194150:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787387837.200437:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.200454:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7ac0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.200461:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.200468:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387837.200473:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.200481:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7ac0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.200499:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:0.0:1787387837.200502:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387837.200506:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7ac0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.200527:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7ac0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387837.202309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387837.204629:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690810624 00000100:00100000:0.0:1787387837.204645:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690810624 00000100:00100000:0.0:1787387837.204716:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:0.0:1787387837.204727:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:10388:x1874211690810624:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1787387837.209206:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387837.209242:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7ac7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528db expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.209334:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7ace lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.209388:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528d4 expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.209399:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7ace lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.209435:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528d4 expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.209452:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528d4 expref: 29 pid: 5807 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387837.209465:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4372013800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709715328:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387837.209835:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435229dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387837.213321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387837.213397:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690810752 00000100:00100000:2.0:1787387837.213408:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690810752 00010000:00010000:2.0:1787387837.213450:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528d4 expref: 30 pid: 5807 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387837.213480:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4372013800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709715328:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387837.213499:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:2.0:1787387837.213510:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:2350:x1874211690810752:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387837.213519:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7ace lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.213526:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387837.213535:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528d4 expref: 30 pid: 5807 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.213548:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528d4 expref: 30 pid: 5807 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.213573:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ab2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528d4 expref: 30 pid: 5807 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.213604:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:2.0:1787387837.213609:0:8324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7ace lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.213620:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.213628:0:8324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7ace lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.213654:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387837.213779:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.213789:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387837.213836:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787387837.213842:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1787387837.213843:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:2350:x1874211690810752:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 332us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387837.213853:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000004:00010000:0.0:1787387837.213874:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.213913:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7ac7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528db expref: 29 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.213933:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528db expref: 28 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.213940:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:0.0:1787387837.213943:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387837.213945:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71800, rc 0) 00000100:00100000:0.0:1787387837.213971:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:10388:x1874211690810624:12345-192.168.204.59@tcp:101:bash.0 Request processed in 9247us (11675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387837.213978:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:0.0:1787387837.218699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387837.218973:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690811008 00000100:00100000:1.0:1787387837.218984:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690811008 00000100:00100000:1.0:1787387837.219056:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:1.0:1787387837.219066:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4365678450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:10388:x1874211690811008:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:1.0:1787387837.219634:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4365678450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:10388:x1874211690811008:12345-192.168.204.59@tcp:35:bash.0 Request processed in 567us (943us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787387837.219645:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:3.0:1787387837.397593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387837.397829:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690811264 00000100:00100000:0.0:1787387837.397843:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690811264 00000100:00100000:0.0:1787387837.397952:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:0.0:1787387837.397965:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:10398:x1874211690811264:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387837.398002:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387837.398041:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7ad5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528e2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387837.398397:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787387837.398605:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7ad5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528e2 expref: 31 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.398625:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:0.0:1787387837.398628:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787387837.398634:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7ad5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528e2 expref: 31 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.399403:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70200, rc 0) 00000100:00100000:1.0:1787387837.408358:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:10398:x1874211690811264:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 10374us (10768us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787387837.408378:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:0.0:1787387837.413110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387837.415213:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690811392 00000100:00100000:3.0:1787387837.415229:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690811392 00000100:00100000:3.0:1787387837.415315:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:3.0:1787387837.415327:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:10398:x1874211690811392:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:3.0:1787387837.415414:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ae3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.415432:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.415444:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.415477:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7aea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.415484:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.415490:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.416441:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7af1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.416454:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.416462:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787387837.417844:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417869:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417876:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ae3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417884:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417890:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152ee00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387837.417895:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417917:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ae3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417934:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387837.417937:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387837.417942:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417948:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417966:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417972:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7aea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417978:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7aea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417983:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387837.417986:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7aea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.417992:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7aea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.418000:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c2d100) 00010000:00010000:3.0:1787387837.418002:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387837.418005:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7aea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.418021:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7aea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.418362:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.418371:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7af1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.418378:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.418384:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387837.418387:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.418394:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7af1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.418403:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387837.418406:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387837.418409:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7af1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387837.418416:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7af1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387837.418620:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:10398:x1874211690811392:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 3289us (5521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387837.418631:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:0.0:1787387837.425469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387837.425575:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690811648 00000100:00100000:2.0:1787387837.425587:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690811648 00000100:00100000:2.0:1787387837.425659:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:2.0:1787387837.425670:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:10398:x1874211690811648:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1787387837.426469:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+31:10398:x1874211690811648:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 798us (1007us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787387837.426479:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1787387837.479039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387837.479206:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690811904 00000100:00100000:1.0:1787387837.479217:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690811904 00000100:00100000:1.0:1787387837.479284:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:1.0:1787387837.479294:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+31:10401:x1874211690811904:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1787387837.479320:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387837.479342:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7af8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528e9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.479419:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7aff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.479433:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7aff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.479444:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7aff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.479460:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7b06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.479468:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.479491:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.479916:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7b0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.479928:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.479936:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387837.479947:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787387837.480240:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7aff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480249:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7aff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480257:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7aff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480263:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387837.480268:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7aff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480275:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7aff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480287:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:1.0:1787387837.480291:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387837.480304:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7aff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480310:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7aff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480324:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480330:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7b06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480336:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480341:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387837.480343:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480349:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7b06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480357:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4358720100) 00010000:00010000:1.0:1787387837.480359:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387837.480362:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7b06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480367:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7b06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480410:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7af8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528e9 expref: 34 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480436:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7b0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528e9 expref: 33 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.480443:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:1.0:1787387837.480446:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787387837.480448:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5c00, rc 0) 00000100:00100000:1.0:1787387837.480555:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+33:10401:x1874211690811904:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1261us (1536us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787387837.480563:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:2.0:1787387837.488055:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387837.488233:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690812032 00000100:00100000:0.0:1787387837.488243:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690812032 00000100:00100000:0.0:1787387837.488300:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1787387837.488310:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+33:10401:x1874211690812032:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1787387837.488376:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.488394:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.488423:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.488456:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.488463:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.488470:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.488476:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387837.488480:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.488488:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.488500:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:0.0:1787387837.488503:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787387837.488507:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.488513:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387837.488607:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+33:10401:x1874211690812032:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 298us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387837.488614:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1787387837.494052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387837.494160:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690812288 00000100:00100000:1.0:1787387837.494171:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690812288 00000100:00100000:1.0:1787387837.494221:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:1.0:1787387837.494231:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+33:10401:x1874211690812288:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1787387837.494467:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:10401:x1874211690812288:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 238us (435us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787387837.494475:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:1.0:1787387837.502560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387837.502673:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690812416 00000100:00100000:2.0:1787387837.502683:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690812416 00000100:00100000:2.0:1787387837.502783:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1787387837.502793:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:2351:x1874211690812416:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387837.502824:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387837.502861:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7b0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528e9 expref: 34 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.502881:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:2.0:1787387837.502886:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387837.502957:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+33:2351:x1874211690812416:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 165us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387837.502965:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:3.0:1787387837.679501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387837.679719:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690812672 00000100:00100000:2.0:1787387837.679730:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690812672 00000100:00100000:2.0:1787387837.679836:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:2.0:1787387837.679846:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+33:10419:x1874211690812672:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:2.0:1787387837.679874:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387837.679905:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7b22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528f0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.680012:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.680026:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.680038:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387837.680050:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787387837.680187:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7b22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528f0 expref: 36 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.680221:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528f0 expref: 35 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.680229:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:2.0:1787387837.680231:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787387837.680235:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90800, rc 0) 00000100:00100000:2.0:1787387837.680291:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10419:x1874211690812672:12345-192.168.204.59@tcp:101:cat.0 Request processed in 447us (800us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787387837.680298:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:3.0:1787387837.703230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387837.705114:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690812800 00000100:00100000:0.0:1787387837.705138:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690812800 00000100:00100000:0.0:1787387837.705215:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:0.0:1787387837.705225:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10420:x1874211690812800:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387837.705250:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387837.705270:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c7b37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528f7 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.705334:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7b3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.705348:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.705359:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387837.705563:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787387837.705567:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387837.705647:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.705675:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c7b37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528f7 expref: 37 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.705692:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7b3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528f7 expref: 36 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.705701:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:0.0:1787387837.705704:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787387837.705715:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70000, rc 0) 00000100:00100000:0.0:1787387837.705842:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:10420:x1874211690812800:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 619us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387837.705851:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:0.0:1787387837.715473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387837.715590:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690813184 00000100:00100000:1.0:1787387837.715601:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690813184 00000100:00100000:1.0:1787387837.715664:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1787387837.715674:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:10420:x1874211690813184:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1787387837.716049:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+37:10420:x1874211690813184:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 375us (584us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787387837.716059:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:2.0:1787387837.728858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387837.729141:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690813312 00000100:00100000:1.0:1787387837.729152:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690813312 00000100:00100000:1.0:1787387837.729227:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:1.0:1787387837.729238:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+37:10420:x1874211690813312:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:1.0:1787387837.729253:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787387837.729279:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7ace lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528db expref: 37 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.729302:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528f0 expref: 36 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.729316:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c79d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5289c expref: 35 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387837.729326:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d000) 00010000:00010000:1.0:1787387837.729338:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387837.730951:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:10420:x1874211690813312:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 1704us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387837.730965:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1787387837.736066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387837.736358:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690813440 00000100:00100000:2.0:1787387837.736370:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690813440 00000100:00100000:2.0:1787387837.736429:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:2.0:1787387837.736440:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:10420:x1874211690813440:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:2.0:1787387837.736568:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7b45 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.736585:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7b45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387837.736597:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7b45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787387837.737551:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387837.737729:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787387837.738993:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787387837.739417:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:10420:x1874211690813440:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 2973us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387837.739436:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:2.0:1787387837.763226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387837.763682:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690813568 00000100:00100000:0.0:1787387837.763693:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690813568 00000100:00100000:0.0:1787387837.763779:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:0.0:1787387837.763790:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:10422:x1874211690813568:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387837.763811:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387837.763833:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c7b4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b528fe expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.763913:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7b53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.763927:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7b53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.763938:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7b53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.763954:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7b5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.763961:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.763967:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764282:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764293:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764301:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387837.764339:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787387837.764343:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387837.764361:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764371:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764379:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7b53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764385:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7b53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764392:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7b53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764397:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387837.764401:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7b53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764407:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7b53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764426:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:0.0:1787387837.764428:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387837.764433:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7b53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764439:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7b53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764451:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764457:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7b5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764462:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7b5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764467:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387837.764469:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7b5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764475:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7b5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764481:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c46200) 00010000:00010000:0.0:1787387837.764483:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387837.764486:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7b5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764490:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7b5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764534:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c7b4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528fe expref: 36 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764547:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528fe expref: 35 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387837.764554:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d436f2f6400) 00010000:00010000:0.0:1787387837.764556:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787387837.764558:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71c00, rc 0) 00000100:00100000:0.0:1787387837.764813:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10422:x1874211690813568:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1024us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387837.764822:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00010000:00010000:2.0:1787387837.790569:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787387837.984077:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387837.984090:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787387837.984160:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787387837.984169:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787387837.984302:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2d8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709715456:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787387837.984410:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643840 going to sleep for 11 seconds 00000100:00100000:0.0:1787387837.989290:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2d8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709715456:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787387837.996160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387837.996430:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690813696 00000100:00100000:1.0:1787387837.996444:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690813696 00000100:00100000:1.0:1787387837.996504:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:1.0:1787387837.996514:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10433:x1874211690813696:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787387837.996613:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10433:x1874211690813696:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 Request processed in 100us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387837.996620:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1787387838.009873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387838.009961:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690813824 00000100:00100000:3.0:1787387838.009971:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690813824 00000100:00100000:3.0:1787387838.010053:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:3.0:1787387838.010064:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10433:x1874211690813824:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787387838.010097:0:5808:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787387838.010229:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10433:x1874211690813824:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 166us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387838.010237:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00080000:0.0:1787387838.010765:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387838.020009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387838.020397:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690813952 00000100:00100000:3.0:1787387838.020409:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690813952 00000100:00100000:3.0:1787387838.020475:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:3.0:1787387838.020485:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10433:x1874211690813952:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787387838.020577:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7b68 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.020607:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7b68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.020620:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7b68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.020693:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7b6f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.020701:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7b6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.020722:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7b6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.020928:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7b76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.020938:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.020946:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387838.020987:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787387838.020991:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387838.021008:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021032:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7b68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021040:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7b68 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021047:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7b68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021053:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387838.021057:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7b68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021064:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7b68 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021084:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:3.0:1787387838.021087:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387838.021092:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7b68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021097:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7b68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021109:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7b6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021126:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7b6f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021133:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7b6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021138:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387838.021141:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7b6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021146:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7b6f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021153:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8d4343c2d100) 00010000:00010000:3.0:1787387838.021156:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387838.021159:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7b6f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021175:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7b6f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021201:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021207:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7b76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021213:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021217:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152ee00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387838.021220:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021225:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7b76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021233:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d436f2f6400) 00010000:00010000:3.0:1787387838.021235:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387838.021238:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7b76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.021244:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7b76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387838.021438:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10433:x1874211690813952:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 951us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387838.021448:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:0.0:1787387838.040147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387838.040264:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690814208 00000100:00100000:2.0:1787387838.040275:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690814208 00000100:00100000:2.0:1787387838.040347:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:2.0:1787387838.040358:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10433:x1874211690814208:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787387838.040383:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387838.040408:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7b7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52905 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040516:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040531:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040544:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387838.040556:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787387838.040679:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040700:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040707:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040712:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387838.040717:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040725:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040758:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d436f2f6400) 00010000:00010000:2.0:1787387838.040762:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787387838.040768:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040774:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040820:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7b7d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52905 expref: 37 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040831:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:2.0:1787387838.040834:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787387838.040838:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7b7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52905 expref: 37 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.040848:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90400, rc 0) 00000100:00100000:2.0:1787387838.040911:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:10433:x1874211690814208:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 555us (776us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787387838.040920:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:2.0:1787387838.046060:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709715712:0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.046165:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387838.046210:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709716224:0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.046240:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387838.046283:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787387838.046290:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709715584:0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.046326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387838.046349:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709716096:0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.046372:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387838.046411:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709715712 00000100:00100000:2.0:1787387838.046419:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709715712 00000100:00100000:2.0:1787387838.046466:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709716096 00000100:00100000:2.0:1787387838.046469:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709716096 00000100:00100000:2.0:1787387838.046503:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787387838.046512:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709715712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.046565:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709715712:12345-0@lo:400:kworker.0 Request processed in 53us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387838.046574:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787387838.046590:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787387838.046772:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709715840:0@lo:400:kworker.0 00000100:00100000:1.0:1787387838.046817:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387838.046832:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387838.046837:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709715968:0@lo:400:kworker.0 00000100:00100000:1.0:1787387838.046857:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387838.046885:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709716224 00000100:00100000:1.0:1787387838.046889:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709716224 00000100:00100000:1.0:1787387838.046916:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709715968 00000100:00100000:1.0:1787387838.046919:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709715968 00000100:00100000:1.0:1787387838.046939:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787387838.046945:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1874211709716224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387838.046978:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1874211709716224:12345-0@lo:400:kworker.0 Request processed in 32us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387838.046984:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787387838.046997:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787387838.047003:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709715968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387838.047047:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709715968:12345-0@lo:400:kworker.0 Request processed in 43us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387838.047053:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787387838.047094:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709715968:0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.047233:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709716096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.047265:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709716096:12345-0@lo:400:kworker.0 Request processed in 669us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387838.047272:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787387838.047290:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709715840 00000100:00100000:2.0:1787387838.047293:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709715840 00000100:00100000:2.0:1787387838.047311:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787387838.047316:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709715840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.047357:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709715840:12345-0@lo:400:kworker.0 Request processed in 40us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387838.047363:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787387838.047385:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709715584 00000100:00100000:2.0:1787387838.047388:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709715584 00000100:00100000:2.0:1787387838.047412:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787387838.047418:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709715584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.047448:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709715584:12345-0@lo:400:kworker.0 Request processed in 30us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387838.047455:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:2.0:1787387838.047484:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387838.047488:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787387838.047491:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387838.047507:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709715584:0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.047518:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709716096:0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.047527:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709715712:0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.047537:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709716224:0@lo:400:kworker.0 00000100:00100000:1.0:1787387838.047834:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709715840:0@lo:400:kworker.0 00000100:00100000:2.0:1787387838.051503:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387838.051586:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690814336 00000100:00100000:3.0:1787387838.051608:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690814336 00000100:00100000:3.0:1787387838.051671:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:3.0:1787387838.051697:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:10433:x1874211690814336:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787387838.051782:0:5807:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787387838.051911:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:10433:x1874211690814336:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 216us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387838.051919:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:1.0:1787387838.055291:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387838.055315:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709716352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387838.055391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387838.055446:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709716352 00000100:00100000:1.0:1787387838.055453:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709716352 00000100:00100000:1.0:1787387838.055502:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787387838.055521:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874211709716352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387838.055573:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387838.057492:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874211709716352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1964us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387838.057510:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787387838.057618:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709716352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387838.060106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387838.065147:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690814592 00000100:00100000:2.0:1787387838.065167:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690814592 00000100:00100000:2.0:1787387838.065397:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:2.0:1787387838.065410:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:10433:x1874211690814592:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787387838.065451:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387838.065454:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787387838.065490:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7b3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528f7 expref: 36 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.065509:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:2.0:1787387838.065514:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787387838.065528:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7b92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5290c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787387838.068230:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787387838.068524:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.068540:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.068552:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.069884:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7b92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5290c expref: 38 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.069910:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5290c expref: 37 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.069919:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:2.0:1787387838.069923:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787387838.069936:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90800, rc 0) 00000100:00100000:2.0:1787387838.070280:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+37:10433:x1874211690814592:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 4871us (10182us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787387838.070291:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:0.0:1787387838.088171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387838.088269:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690814848 00000100:00100000:2.0:1787387838.088280:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690814848 00000100:00100000:2.0:1787387838.088345:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:2.0:1787387838.088356:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+37:10433:x1874211690814848:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787387838.088423:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387838.088452:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7b99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5290c expref: 37 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.088475:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:2.0:1787387838.088487:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787387838.088511:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7ba7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.088524:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.088535:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.088628:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7bae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd2d8ea2b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.088640:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2d8ea2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.088648:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2d8ea2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089189:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089199:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7ba7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089205:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7ba7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089211:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387838.089216:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7ba7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089223:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7ba7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089234:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:2.0:1787387838.089237:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387838.089241:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7ba7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089247:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7ba7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089257:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2d8ea2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089262:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7bae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2d8ea2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089269:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7bae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2d8ea2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089279:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387838.089283:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7bae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2d8ea2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089290:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7bae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2d8ea2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089298:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd2d8ea2b (ffff8d436f2f6a00) 00010000:00010000:2.0:1787387838.089300:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387838.089303:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7bae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd2d8ea2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.089309:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7bae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd2d8ea2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387838.089395:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:10433:x1874211690814848:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1039us (1234us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387838.089405:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:0.0:1787387838.104997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387838.105176:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690814976 00000100:00100000:1.0:1787387838.105188:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690814976 00000100:00100000:1.0:1787387838.105249:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:1.0:1787387838.105259:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:10433:x1874211690814976:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787387838.105284:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387838.105312:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52913 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.105357:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7bbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.105371:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.105385:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.105497:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52913 expref: 38 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.105517:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7bbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52913 expref: 37 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.105532:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d4358720100) 00010000:00010000:1.0:1787387838.105535:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787387838.105539:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4c00, rc 0) 00000100:00100000:1.0:1787387838.105607:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+37:10433:x1874211690814976:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 349us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387838.105614:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:1.0:1787387838.110456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387838.112966:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690815232 00000100:00100000:0.0:1787387838.112982:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690815232 00000100:00100000:0.0:1787387838.113095:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:0.0:1787387838.113106:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+37:10433:x1874211690815232:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787387838.113254:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.114336:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.114348:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787387838.114679:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787387838.114690:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342563950337ns, next at 343563948395ns, rc = 0 00000004:00010000:0.0:1787387838.114807:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000497b43f1 reply state 00000000bc8250d5 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387838.114818:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387838.114950:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+39:10433:x1874211690815232:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1842us (4505us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787387838.114958:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00010000:00010000:3.0:1787387838.116313:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.116331:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.116338:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.116344:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387838.116350:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.116357:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.116376:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d4358720100) 00010000:00010000:3.0:1787387838.116379:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787387838.116384:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.116391:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387838.118727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387838.133796:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690815360 00000100:00100000:1.0:1787387838.133812:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690815360 00000100:00100000:1.0:1787387838.133912:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:1.0:1787387838.133924:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+38:10433:x1874211690815360:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787387838.133950:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387838.133971:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5291a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.134036:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5291a expref: 39 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.134051:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5291a expref: 39 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.134072:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d4358720100) 00010000:00010000:1.0:1787387838.134075:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787387838.134080:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5000, rc 0) 00000100:00100000:1.0:1787387838.134168:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+39:10433:x1874211690815360:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 246us (15452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387838.134189:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:3.0:1787387838.139516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387838.140644:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690815488 00000100:00100000:0.0:1787387838.140660:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690815488 00000100:00100000:0.0:1787387838.140714:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:0.0:1787387838.140723:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874211690815488:12345-192.168.204.59@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787387838.140780:0:6605:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:0.0:1787387838.140925:0:6605:0:(genops.c:1406:class_connect()) connect: client d7138a1c-1444-4499-9235-7f89dd5ceb0b, cookie 0x93d41aeaa23c7bd1 00002000:00100000:0.0:1787387838.140939:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d7138a1c-1444-4499-9235-7f89dd5ceb0b/ffff8d43518e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787387838.140964:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:0.0:1787387838.141324:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787387838.141364:0:6605:0:(import.c:65:import_set_state_nolock()) ffff8d43518e4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387838.141493:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2349:x1874211690815488:12345-192.168.204.59@tcp:8:lhsmtool_posix.0 Request processed in 769us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387838.141509:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:1.0:1787387838.151231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387838.151295:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690815616 00000100:00100000:3.0:1787387838.151321:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690815616 00000100:00100000:3.0:1787387838.151400:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:3.0:1787387838.151413:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:0:x1874211690815616:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787387838.151923:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787387838.284273:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000001:00080000:0.0:1787387838.284294:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1787387838.288998:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:0:x1874211690815616:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 137577us (137766us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787387838.289085:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:3.0:1787387838.293047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387838.293291:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690815872 00000100:00100000:1.0:1787387838.293302:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690815872 00000100:00100000:1.0:1787387838.293367:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1787387838.293378:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+39:10433:x1874211690815872:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787387838.293629:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+40:10433:x1874211690815872:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 252us (590us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787387838.293638:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:3.0:1787387838.297221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387838.297799:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690816128 00000100:00100000:1.0:1787387838.297809:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690816128 00000100:00100000:1.0:1787387838.297882:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:1.0:1787387838.297891:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+40:10433:x1874211690816128:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787387838.297998:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+40:10433:x1874211690816128:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 108us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387838.298005:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:1.0:1787387838.311229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387838.312713:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690816256 00000100:00100000:0.0:1787387838.312725:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690816256 00000100:00100000:0.0:1787387838.312798:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:0.0:1787387838.312808:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+40:10433:x1874211690816256:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787387838.312841:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387838.312864:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7bd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52921 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.312941:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7bdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.312957:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.312969:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387838.313007:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387838.313026:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.313050:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7bd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52921 expref: 42 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.313066:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7bdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52921 expref: 41 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.313095:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d4358720100) 00010000:00010000:0.0:1787387838.313098:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787387838.313102:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70800, rc 0) 00000100:00100000:0.0:1787387838.313175:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:10433:x1874211690816256:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 368us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387838.313183:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:3.0:1787387838.318836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387838.319107:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690816384 00000100:00100000:0.0:1787387838.319128:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690816384 00000100:00100000:0.0:1787387838.319188:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:0.0:1787387838.319199:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2351:x1874211690816384:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787387838.319222:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387838.319248:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048d4207d/0x93d41aeaa23c7be6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52928 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787387838.319277:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a895fbe, blocks: 0x1 00010000:00010000:0.0:1787387838.319296:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:0.0:1787387838.319300:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387838.319309:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048d4207d/0x93d41aeaa23c7be6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52928 expref: 6 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.319327:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000048d4207d/0x93d41aeaa23c7be6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52928 expref: 6 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.319340:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71a00, rc 0) 00000100:00100000:0.0:1787387838.319418:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690816384:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 220us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387838.319425:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:0.0:1787387838.325078:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387838.325160:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690816640 00000100:00100000:3.0:1787387838.325172:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690816640 00000100:00100000:3.0:1787387838.325233:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:3.0:1787387838.325243:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:10433:x1874211690816640:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787387838.325353:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:10433:x1874211690816640:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 111us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387838.325361:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:2.0:1787387838.339337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387838.340958:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690816768 00000100:00100000:3.0:1787387838.340974:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690816768 00000100:00100000:3.0:1787387838.341033:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:3.0:1787387838.341044:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:10433:x1874211690816768:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387838.342182:0:11067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387838.342208:0:11067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5292f expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.342240:0:11067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000048d4207d/0x93d41aeaa23c7be6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52928 expref: 7 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.342249:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387838.342253:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387838.342266:0:11067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 7 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.342309:0:11067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000048d4207d/0x93d41aeaa23c7be6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52928 expref: 7 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.342325:0:11067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000048d4207d/0x93d41aeaa23c7be6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52928 expref: 7 pid: 6606 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387838.342339:0:11067:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11067:1874211709716480:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387838.342444:0:11067:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374241480 going to sleep for 11 seconds 00000100:00100000:0.0:1787387838.357481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387838.357511:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690816896 00000100:00100000:0.0:1787387838.357521:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690816896 00010000:00010000:0.0:1787387838.357563:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000048d4207d/0x93d41aeaa23c7be6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52928 expref: 8 pid: 6606 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387838.357600:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:0.0:1787387838.357610:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2351:x1874211690816896:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387838.357684:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387838.357710:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000048d4207d/0x93d41aeaa23c7be6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52928 expref: 8 pid: 6606 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.357726:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000048d4207d/0x93d41aeaa23c7be6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52928 expref: 8 pid: 6606 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.357790:0:8324:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387838.357796:0:8324:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387838.357805:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 8 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.357814:0:8324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 8 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.357922:0:8324:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 8 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387838.357938:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4372013100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8324:1874211709716608:192.168.204.59@tcp:105: 00000100:00100000:0.0:1787387838.358297:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43438dec00 going to sleep for 11 seconds 00010000:00010000:2.0:1787387838.360103:0:11067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048d4207d/0x93d41aeaa23c7be6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52928 expref: 8 pid: 6606 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387838.360138:0:11067:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11067:1874211709716480:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387838.360165:0:11067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 7 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.360198:0:11067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152ee00, rc 0) 00000100:00100000:2.0:1787387838.360262:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:10433:x1874211690816768:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 19220us (20936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387838.360272:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:0.0:1787387838.364882:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4372013100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8324:1874211709716608:192.168.204.59@tcp:105: 00010000:00010000:0.0:1787387838.364910:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387838.364960:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690816896:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 7350us (7487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387838.364972:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:1.0:1787387838.369987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387838.370185:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690817024 00000100:00100000:3.0:1787387838.370196:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690817024 00002000:00100000:3.0:1787387838.370247:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d437a080a80 x1874211690817024/t0(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:94/0 lens 504/0 e 0 to 0 dl 1787387849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787387838.370257:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d437a080a80 with x1874211690817024 ext(0->8) 00002000:00010000:3.0:1787387838.370263:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d437a080a80 00000100:00100000:3.0:1787387838.370296:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1787387838.370305:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690817024:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787387838.371009:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690817024:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 702us (1029us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787387838.371020:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00002000:00100000:3.0:1787387838.371028:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d437a080a80 x1874211690817024/t4294967302(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:94/0 lens 504/448 e 0 to 0 dl 1787387849 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787387838.371038:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d437a080a80 with x1874211690817024 ext(0->8) 00002000:00010000:3.0:1787387838.371050:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d437a080a80 00000100:00100000:0.0:1787387838.377057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387838.377732:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690817152 00000100:00100000:1.0:1787387838.377774:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690817152 00000100:00100000:1.0:1787387838.377850:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:1.0:1787387838.377874:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:10433:x1874211690817152:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787387838.486373:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:10433:x1874211690817152:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 108489us (109314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387838.486386:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00000001:00080000:2.0:1787387838.486425:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1787387838.486432:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:2.0:1787387838.486605:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1787387838.486622:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1787387838.486866:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787387838.486877:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787387838.486947:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709716736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787387838.486999:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387838.487408:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709716736 00000100:00100000:0.0:1787387838.487418:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709716736 00000100:00100000:1.0:1787387838.487844:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787387838.487858:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709716736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787387838.488194:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787387838.488198:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787387838 00002000:00010000:1.0:1787387838.488200:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787387838.488202:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787387838 -> 1787387838 00002000:00010000:1.0:1787387838.488204:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787387838.488305:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709716736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 450us (1304us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787387838.488313:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1787387838.488377:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d437a5d8000/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787387838.488385:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709716736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787387838.489083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387838.489163:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690817280 00000100:00100000:1.0:1787387838.489171:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690817280 00000100:00100000:1.0:1787387838.489221:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:1.0:1787387838.489230:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2353:x1874211690817280:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787387838.540887:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2353:x1874211690817280:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 51647us (51795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387838.540902:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000001:00080000:0.0:1787387838.540985:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1787387838.540997:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1787387838.554391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387838.554498:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690817536 00000100:00100000:1.0:1787387838.554509:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690817536 00000100:00100000:1.0:1787387838.554585:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:1.0:1787387838.554596:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:10433:x1874211690817536:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787387838.554663:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387838.554693:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7bdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52921 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.554726:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d4358720100) 00010000:00010000:1.0:1787387838.554733:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787387838.554804:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7bf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.554819:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.554830:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787387838.555866:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000445f1117 reply state 000000002f00d10d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387838.555881:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787387838.555999:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:10433:x1874211690817536:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1402us (1616us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787387838.560098:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 81 00010000:00010000:1.0:1787387838.569087:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.569114:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7bf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.569123:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7bf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.569130:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387838.569135:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7bf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.569153:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7bf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.569170:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d4358720100) 00010000:00010000:1.0:1787387838.569173:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387838.569178:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7bf4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.569185:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7bf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387838.569334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387838.569503:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690817664 00000100:00100000:1.0:1787387838.569512:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690817664 00000100:00100000:1.0:1787387838.569573:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:1.0:1787387838.569582:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690817664:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787387838.569845:0:6606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787387838.569848:0:6606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787387838 -> 1787387837 00002000:00010000:1.0:1787387838.569851:0:6606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787387836 00002000:00010000:1.0:1787387838.569853:0:6606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787387838 -> 1787387837 00002000:00010000:1.0:1787387838.569855:0:6606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787387838.569912:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690817664:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 330us (580us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787387838.569920:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1787387838.595322:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387838.595411:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690817920 00000100:00100000:0.0:1787387838.595423:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690817920 00000100:00100000:0.0:1787387838.595488:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:0.0:1787387838.595498:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:10433:x1874211690817920:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787387838.595582:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.595599:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7bbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52913 expref: 13 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.595627:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.595663:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7bbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52913 expref: 13 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.595675:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7bbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52913 expref: 13 pid: 6840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387838.595690:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4372013100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709716864:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387838.595801:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787387838.601784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387838.603397:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690818048 00000100:00100000:2.0:1787387838.603410:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690818048 00010000:00010000:2.0:1787387838.603453:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7bbc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52913 expref: 14 pid: 6840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387838.603488:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1787387838.603496:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:2350:x1874211690818048:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387838.603510:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387838.603517:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7bbc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52913 expref: 14 pid: 6840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603560:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7bbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52913 expref: 14 pid: 6840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603584:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d4358720100) 00010000:00010000:2.0:1787387838.603590:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603599:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603607:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603634:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387838.603693:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:2350:x1874211690818048:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 196us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387838.603701:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00010000:00010000:2.0:1787387838.603766:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7bbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52913 expref: 13 pid: 6840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387838.603782:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4372013100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709716864:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387838.603800:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603808:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603813:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603848:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603854:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603860:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603865:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387838.603870:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603877:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603886:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d4358720100) 00010000:00010000:2.0:1787387838.603888:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787387838.603891:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.603896:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7bfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387838.603935:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+12:10433:x1874211690817920:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 8439us (8626us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787387838.603943:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:0.0:1787387838.613379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387838.614125:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690818176 00000100:00100000:2.0:1787387838.614137:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690818176 00000100:00100000:2.0:1787387838.614211:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:2.0:1787387838.614228:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2353:x1874211690818176:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787387838.614273:0:11067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.614292:0:11067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 7 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.614302:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787387838.614306:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387838.614310:0:11067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.614343:0:11067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 7 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.614356:0:11067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 7 pid: 11067 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387838.614372:0:11067:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a27bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11067:1874211709716992:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387838.614455:0:11067:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43457c6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387838.617539:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387838.617582:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690818304 00000100:00100000:2.0:1787387838.617591:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690818304 00010000:00010000:2.0:1787387838.617629:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 8 pid: 11067 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387838.617664:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:2.0:1787387838.617685:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2351:x1874211690818304:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387838.617701:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387838.617725:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 8 pid: 11067 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.617760:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 8 pid: 11067 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.617792:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387838.617797:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387838.617803:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.617814:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.617840:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387838.617889:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2351:x1874211690818304:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 206us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387838.617896:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00010000:00010000:3.0:1787387838.618387:0:11067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a606175c/0x93d41aeaa23c7bed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5292f expref: 7 pid: 11067 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387838.618404:0:11067:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a27bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11067:1874211709716992:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387838.618425:0:11067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.618436:0:11067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.618443:0:11067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.618468:0:11067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.618476:0:11067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.618499:0:11067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.618506:0:11067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387838.618511:0:11067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.618519:0:11067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.618534:0:11067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.618541:0:11067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c7c02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387838.618614:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2353:x1874211690818176:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 4388us (5245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387838.618622:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:2.0:1787387838.629080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387838.629265:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690818560 00000100:00100000:1.0:1787387838.629275:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690818560 00000100:00100000:1.0:1787387838.629327:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:1.0:1787387838.629337:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+12:10433:x1874211690818560:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787387838.629424:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7c09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.629441:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.629454:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.629678:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.629689:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5291a expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.629697:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.629732:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5291a expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387838.629770:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5291a expref: 13 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387838.629786:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a081500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709717120:192.168.204.59@tcp:104: 00000100:00100000:1.0:1787387838.629864:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a3f09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387838.641352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387838.644020:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690818688 00000100:00100000:0.0:1787387838.644034:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690818688 00010000:00010000:0.0:1787387838.644088:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bca lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5291a expref: 14 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387838.644138:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:0.0:1787387838.644148:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:2351:x1874211690818688:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387838.644162:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387838.644169:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bca lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5291a expref: 14 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.644183:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5291a expref: 14 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.644225:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d4358720100) 00010000:00010000:0.0:1787387838.644230:0:8324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.644239:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.644245:0:8324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.644265:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387838.644325:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:2351:x1874211690818688:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 179us (2982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387838.644332:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00010000:00010000:1.0:1787387838.650935:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7bca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5291a expref: 13 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387838.650963:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a081500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709717120:192.168.204.59@tcp:104: 00010000:00010000:1.0:1787387838.650999:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.660333:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.660351:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387838.660565:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787387838.660721:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787387838.660798:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787387838.660911:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4372012300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6840:1874211709717248:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787387838.660991:0:6840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387838.662162:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387838.662284:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709717248 00000100:00100000:2.0:1787387838.662293:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709717248 00000100:00100000:2.0:1787387838.662354:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387838.662365:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6840:x1874211709717248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787387838.662470:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6840:x1874211709717248:12345-0@lo:1000:mdt00_003.0 Request processed in 107us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387838.662489:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387838.662528:0:6840:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787387838.662533:0:6840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d437a5d8000, transno 4294967303 00000100:00100000:2.0:1787387838.662561:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4372012300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6840:1874211709717248:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787387838.665199:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787387838.665291:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6840:1874211709717376:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787387838.665357:0:6840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387838.665390:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435134b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387838.665562:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709717376 00000100:00100000:3.0:1787387838.665570:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709717376 00000100:00100000:3.0:1787387838.665617:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787387838.665626:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6840:x1874211709717376:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787387838.665831:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6840:x1874211709717376:12345-0@lo:1000:mdt00_003.0 Request processed in 205us (472us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787387838.665845:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387838.667185:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6840:1874211709717376:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787387838.667234:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667245:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667252:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667258:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387838.667263:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667271:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667287:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d4358720100) 00010000:00010000:2.0:1787387838.667290:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387838.667295:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667311:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5e00/0x93d41aeaa23c7c10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667350:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7b45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667357:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7b45 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667363:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7b45 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667367:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387838.667371:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7b45 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667376:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7b45 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667385:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d436f2f6400) 00010000:00010000:2.0:1787387838.667388:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387838.667391:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7b45 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667396:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7b45 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667420:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667433:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528fe expref: 16 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667448:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667480:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528fe expref: 16 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.667494:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528fe expref: 16 pid: 6840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387838.667507:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a278700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709717504:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387838.669711:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4345c0ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787387838.673714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387838.674340:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690818816 00000100:00100000:2.0:1787387838.674351:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690818816 00010000:00010000:2.0:1787387838.674391:0:11042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528fe expref: 17 pid: 6840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387838.674424:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:2.0:1787387838.674434:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:2350:x1874211690818816:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387838.674449:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387838.674456:0:11042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528fe expref: 17 pid: 6840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.674470:0:11042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528fe expref: 17 pid: 6840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.674493:0:11042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d436f2f6400) 00010000:00010000:2.0:1787387838.674506:0:11042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.674516:0:11042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.674524:0:11042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.674556:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387838.674610:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:2350:x1874211690818816:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 176us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387838.674618:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00010000:00010000:0.0:1787387838.679621:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7b61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b528fe expref: 16 pid: 6840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387838.679663:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a278700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709717504:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387838.679689:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679698:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679705:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679718:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679724:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679731:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679756:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387838.679761:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679768:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679783:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d436f2f6400) 00010000:00010000:0.0:1787387838.679787:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387838.679791:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679807:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7c17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679819:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679825:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7c09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679831:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7c09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679835:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387838.679838:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7c09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679843:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7c09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679852:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d436f2f6400) 00010000:00010000:0.0:1787387838.679854:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787387838.679857:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7c09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.679862:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7c09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387838.680252:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:10433:x1874211690818560:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 50913us (51179us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787387838.680261:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00000020:00080000:0.0:1787387838.680273:0:6840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787387838.680500:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387838.680506:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787387838.680532:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787387838.680539:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787387838.682698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387838.682792:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690819072 00000100:00100000:0.0:1787387838.682802:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690819072 00000100:00100000:0.0:1787387838.682856:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:0.0:1787387838.682867:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:10433:x1874211690819072:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787387838.683521:0:5810:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787387838.683623:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1787387838.683668:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7c1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.683684:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.683694:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.683702:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7c1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.683708:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7c1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.683715:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7c1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.683877:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787387838.683967:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:10433:x1874211690819072:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 1100us (1274us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787387838.683976:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000020:00080000:0.0:1787387838.683981:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787387838.691795:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387838.691811:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7c1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.691822:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70e00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387838.691827:0:11539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7c1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.691836:0:11539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7c1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.691854:0:11539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d4343c46d00) 00010000:00010000:3.0:1787387838.691857:0:11539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787387838.691862:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7c1e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.691867:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7c1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387838.692032:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387838.692035:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387838.692037:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787387838.768565:0:11876:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787387838.768576:0:11876:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787387838.768614:0:11876:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787387838.768620:0:11876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787387838.819854:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387838.951921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387838.952022:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690819328 00000100:00100000:0.0:1787387838.952044:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690819328 00000100:00100000:0.0:1787387838.952115:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:0.0:1787387838.952126:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:10443:x1874211690819328:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387838.952159:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387838.952193:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7c25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52936 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.952460:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7c2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.952475:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7c2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.952487:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7c2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387838.952500:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787387838.952698:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c7c25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52936 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.952718:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7c2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52936 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387838.952726:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:0.0:1787387838.952729:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787387838.952733:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71600, rc 0) 00000100:00100000:0.0:1787387838.952824:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:10443:x1874211690819328:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 700us (912us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787387838.952832:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:0.0:1787387838.955985:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387838.956124:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690819456 00000100:00100000:3.0:1787387838.956136:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690819456 00000100:00100000:3.0:1787387838.956204:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:3.0:1787387838.956213:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:10443:x1874211690819456:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:3.0:1787387838.956307:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956324:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956336:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956351:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956360:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956367:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956678:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956688:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956695:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787387838.956767:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956781:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956799:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956806:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956813:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152ee00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387838.956817:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956826:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956839:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387838.956842:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387838.956847:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956853:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956866:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956872:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956879:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956884:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387838.956895:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956902:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956910:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c2de00) 00010000:00010000:3.0:1787387838.956913:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387838.956916:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956922:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956940:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956946:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956953:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956958:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387838.956960:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956966:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956974:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2d100) 00010000:00010000:3.0:1787387838.956976:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387838.956985:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387838.956991:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387838.957092:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:10443:x1874211690819456:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 878us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387838.957111:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:0.0:1787387839.009593:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.009791:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690819712 00000100:00100000:3.0:1787387839.009802:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690819712 00000100:00100000:3.0:1787387839.009853:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:3.0:1787387839.009863:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:10446:x1874211690819712:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387839.009886:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387839.009909:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7c4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5293d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.009982:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.009997:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010022:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010036:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010044:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010073:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010426:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010434:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010443:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387839.010453:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787387839.010542:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010551:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010557:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010563:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387839.010567:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010574:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010586:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387839.010590:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387839.010601:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010607:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010618:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010625:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010631:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010636:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387839.010639:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010644:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010652:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c2d100) 00010000:00010000:3.0:1787387839.010654:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387839.010657:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010662:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010701:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7c4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5293d expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010726:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5293d expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.010734:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:3.0:1787387839.010758:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387839.010761:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152ee00, rc 0) 00000100:00100000:3.0:1787387839.010833:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:10446:x1874211690819712:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 971us (1251us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787387839.010841:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:3.0:1787387839.018456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.018534:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690819840 00000100:00100000:2.0:1787387839.018543:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690819840 00000100:00100000:2.0:1787387839.018608:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:2.0:1787387839.018618:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:10446:x1874211690819840:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:2.0:1787387839.018683:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.018712:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.018735:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.018783:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.018790:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.018796:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.018802:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387839.018806:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.018813:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.018825:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:2.0:1787387839.018828:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787387839.018833:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.018839:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387839.018911:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:10446:x1874211690819840:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 294us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387839.018920:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:0.0:1787387839.025035:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.025225:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690820096 00000100:00100000:3.0:1787387839.025237:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690820096 00000100:00100000:3.0:1787387839.025295:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1787387839.025304:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d436567a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:10446:x1874211690820096:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1787387839.025533:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d436567a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:10446:x1874211690820096:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 229us (506us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787387839.025541:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1787387839.078352:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709717632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387839.078439:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387839.078584:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709717632 00000100:00100000:3.0:1787387839.078593:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709717632 00000100:00100000:3.0:1787387839.078640:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787387839.078650:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874211709717632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787387839.078675:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787387839.078763:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874211709717632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387839.078771:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787387839.078843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.078910:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709717632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387839.078936:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690820352 00000100:00100000:3.0:1787387839.078939:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690820352 00000100:00100000:3.0:1787387839.078965:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:3.0:1787387839.078972:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:9975:x1874211690820352:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1787387839.078987:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387839.079800:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7c79 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52944 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.079902:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.079917:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5293d expref: 23 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.079926:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.079963:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5293d expref: 23 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.079977:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5293d expref: 23 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387839.081471:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709717760:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387839.081556:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43452e4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787387839.094900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.095147:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709717760:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387839.095176:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387839.099904:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690820480 00000100:00100000:2.0:1787387839.099934:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690820480 00010000:00010000:2.0:1787387839.099979:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5293d expref: 24 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387839.105560:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:2.0:1787387839.105583:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:2351:x1874211690820480:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387839.105605:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387839.105615:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5293d expref: 24 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.105630:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5293d expref: 24 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.105655:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7c64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5293d expref: 24 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.105673:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:2.0:1787387839.105678:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.105688:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.105708:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.105752:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387839.105815:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:2351:x1874211690820480:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 245us (10924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387839.105840:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00010000:00010000:2.0:1787387839.106816:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.106828:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387839.106849:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787387839.107024:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7c79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52944 expref: 24 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.107043:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52944 expref: 23 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.107051:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:2.0:1787387839.107053:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787387839.107056:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f400, rc 0) 00000100:00100000:2.0:1787387839.107121:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:9975:x1874211690820352:12345-192.168.204.59@tcp:101:bash.0 Request processed in 28148us (28278us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787387839.107129:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:2.0:1787387839.111325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.111399:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690820736 00000100:00100000:3.0:1787387839.111410:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690820736 00000100:00100000:3.0:1787387839.111506:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:3.0:1787387839.111517:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:9975:x1874211690820736:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:3.0:1787387839.111884:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.111901:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.111912:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787387839.111977:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787387839.112003:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000010a7bf9e reply state 00000000fe1b1222 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387839.112013:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787387839.112065:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787387839.112178:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:9975:x1874211690820736:12345-192.168.204.59@tcp:36:bash.0 Request processed in 662us (863us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787387839.112187:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 89 00000020:00080000:3.0:1787387839.112205:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787387839.119845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.120027:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690820864 00000100:00100000:2.0:1787387839.120037:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690820864 00000100:00100000:2.0:1787387839.120106:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:2.0:1787387839.120117:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:9975:x1874211690820864:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1787387839.120142:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387839.120164:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5294b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.120246:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5294b expref: 28 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.120261:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5294b expref: 28 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.120282:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:2.0:1787387839.120285:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387839.120289:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90800, rc 0) 00000100:00100000:2.0:1787387839.120347:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:9975:x1874211690820864:12345-192.168.204.59@tcp:101:bash.0 Request processed in 232us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387839.120354:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 90 00010000:00010000:3.0:1787387839.120711:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.120721:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.120727:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.120733:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387839.120765:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.120774:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.120785:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:3.0:1787387839.120787:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387839.120791:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.120798:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7c8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387839.131504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387839.131586:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690820992 00000100:00100000:1.0:1787387839.131599:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690820992 00000100:00100000:1.0:1787387839.131666:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1787387839.131676:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:9975:x1874211690820992:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1787387839.131695:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387839.131721:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010fc1935/0x93d41aeaa23c7c9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52952 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787387839.131785:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a895fbd, atime: 0x6a895fbc, ctime: 0x6a895fbd, blocks: 0xb 00010000:00010000:1.0:1787387839.131806:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:1.0:1787387839.131811:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387839.131819:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010fc1935/0x93d41aeaa23c7c9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52952 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.131836:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010fc1935/0x93d41aeaa23c7c9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52952 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.131849:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5000, rc 0) 00000100:00100000:1.0:1787387839.131907:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:9975:x1874211690820992:12345-192.168.204.59@tcp:101:bash.0 Request processed in 231us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387839.131915:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:2.0:1787387839.135106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387839.135253:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690821120 00000100:00100000:0.0:1787387839.135263:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690821120 00002000:00010000:0.0:1787387839.135305:0:6609:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787387839.135309:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d437a27b100 with x1874211690821120 ext(0->18446744073709551615) 00002000:00010000:0.0:1787387839.135322:0:6609:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d437a27b100. 00000100:00100000:0.0:1787387839.135344:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1787387839.135354:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690821120:12345-192.168.204.59@tcp:10:bash.0 00002000:00010000:0.0:1787387839.135642:0:6609:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787387839.135646:0:6609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787387837 -> 1787387839 00002000:00010000:0.0:1787387839.135649:0:6609:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787387836 -> 1787387836 00002000:00010000:0.0:1787387839.135651:0:6609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787387837 -> 1787387839 00002000:00010000:0.0:1787387839.135653:0:6609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787387839.135735:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690821120:12345-192.168.204.59@tcp:10:bash.0 Request processed in 381us (646us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787387839.135770:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00002000:00010000:0.0:1787387839.135774:0:6609:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787387839.135777:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d437a27b100 with x1874211690821120 ext(0->18446744073709551615) 00002000:00010000:0.0:1787387839.135782:0:6609:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d437a27b100. 00000100:00100000:0.0:1787387839.231492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.231602:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690821248 00000100:00100000:2.0:1787387839.231612:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690821248 00000100:00100000:2.0:1787387839.231673:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:2.0:1787387839.231685:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:10460:x1874211690821248:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:2.0:1787387839.231815:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7ca3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.231833:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.231846:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.231881:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7caa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.231889:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.231897:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232408:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232418:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232426:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787387839.232465:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232476:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232482:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7ca3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232489:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232495:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387839.232499:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232513:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7ca3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232525:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:2.0:1787387839.232528:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387839.232532:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7ca3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232538:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7ca3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232550:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232556:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7caa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232561:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7caa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232566:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387839.232569:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7caa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232574:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7caa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232581:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d436f2f6a00) 00010000:00010000:2.0:1787387839.232583:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387839.232586:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7caa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232601:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7caa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232615:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232620:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232626:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232630:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387839.232633:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232638:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232644:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:2.0:1787387839.232646:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387839.232649:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.232653:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387839.232882:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:10460:x1874211690821248:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 1197us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387839.232891:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:1.0:1787387839.298296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.298809:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690821504 00000100:00100000:2.0:1787387839.298820:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690821504 00000100:00100000:2.0:1787387839.298887:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:2.0:1787387839.298899:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:10463:x1874211690821504:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1787387839.298920:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387839.298944:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52959 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299023:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7cbf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299038:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7cbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299050:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7cbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299065:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7cc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299072:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299079:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299454:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7ccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299464:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299485:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387839.299498:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787387839.299600:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7cbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299609:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7cbf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299616:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7cbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299622:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387839.299627:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7cbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299635:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7cbf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299649:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:2.0:1787387839.299652:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387839.299657:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7cbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299664:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c7cbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299680:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299686:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7cc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299712:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299717:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387839.299721:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299728:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299815:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d436f2f6a00) 00010000:00010000:2.0:1787387839.299819:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387839.299822:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7cc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299828:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c7cc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299874:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c7cb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52959 expref: 30 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299890:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7ccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52959 expref: 29 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.299897:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:2.0:1787387839.299899:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787387839.299902:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91800, rc 0) 00000100:00100000:2.0:1787387839.299967:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:10463:x1874211690821504:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1071us (1686us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787387839.299986:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:1.0:1787387839.302862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.303112:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690821632 00000100:00100000:2.0:1787387839.303122:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690821632 00000100:00100000:2.0:1787387839.303186:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:2.0:1787387839.303197:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:10463:x1874211690821632:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:2.0:1787387839.303273:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.303290:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52944 expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.303299:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.303335:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52944 expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.303350:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52944 expref: 29 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387839.303365:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a279880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709717888:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387839.303472:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43438de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387839.309820:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.309926:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690821888 00000100:00100000:3.0:1787387839.309937:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690821888 00000100:00100000:3.0:1787387839.310185:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1787387839.310197:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:5567:x1874211690821888:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787387839.310558:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+31:5567:x1874211690821888:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 362us (748us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787387839.310584:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:2.0:1787387839.310658:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a279880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709717888:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387839.310685:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387839.319416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.320322:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690822016 00000100:00100000:2.0:1787387839.320349:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690822016 00010000:00010000:2.0:1787387839.322288:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52944 expref: 31 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387839.322405:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:2.0:1787387839.322425:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a083480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+31:2351:x1874211690822016:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387839.322444:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387839.322452:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52944 expref: 31 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.322466:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52944 expref: 31 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.322490:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7c80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52944 expref: 31 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.322511:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:2.0:1787387839.322516:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.322525:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.322532:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.322582:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387839.322702:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a083480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:2351:x1874211690822016:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 287us (3295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387839.322728:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00010000:00010000:3.0:1787387839.322836:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.322845:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.322887:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.322895:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.322903:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.322909:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387839.322914:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.322921:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.322931:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:3.0:1787387839.322935:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787387839.322939:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.322945:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c7cdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387839.323006:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:10463:x1874211690821632:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 19810us (20153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387839.323022:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:0.0:1787387839.327254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387839.327365:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690822272 00000100:00100000:1.0:1787387839.327376:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690822272 00000100:00100000:1.0:1787387839.327469:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:1.0:1787387839.327480:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:10463:x1874211690822272:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1787387839.327919:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:10463:x1874211690822272:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 439us (674us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787387839.327928:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:1.0:1787387839.420667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.420808:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690822528 00000100:00100000:2.0:1787387839.420818:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690822528 00000100:00100000:2.0:1787387839.420875:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:2.0:1787387839.420886:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:10474:x1874211690822528:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:2.0:1787387839.420912:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387839.420934:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ce2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52960 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421023:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ce9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421038:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421050:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421065:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7cf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421072:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421079:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421445:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7cf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421465:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421472:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387839.421483:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787387839.421588:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421596:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ce9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421603:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421608:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387839.421612:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421619:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ce9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421631:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:2.0:1787387839.421634:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387839.421641:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421649:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421662:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421675:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7cf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421681:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421687:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fde00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387839.421690:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421697:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421706:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d436f2f6a00) 00010000:00010000:2.0:1787387839.421709:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387839.421711:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7cf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421717:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7cf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421832:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ce2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52960 expref: 33 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421850:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52960 expref: 32 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.421858:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:2.0:1787387839.421860:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787387839.421869:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fda00, rc 0) 00000100:00100000:2.0:1787387839.421935:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+32:10474:x1874211690822528:12345-192.168.204.59@tcp:101:cat.0 Request processed in 1047us (1274us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787387839.421943:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:0.0:1787387839.430385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.430567:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690822784 00000100:00100000:3.0:1787387839.430578:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690822784 00000100:00100000:3.0:1787387839.430639:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:3.0:1787387839.430649:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+32:10474:x1874211690822784:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:3.0:1787387839.430936:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+33:10474:x1874211690822784:12345-192.168.204.59@tcp:35:cat.0 Request processed in 287us (560us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787387839.430945:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:1.0:1787387839.451080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.451317:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690823040 00000100:00100000:3.0:1787387839.451327:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690823040 00000100:00100000:3.0:1787387839.451389:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:3.0:1787387839.451399:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+33:10475:x1874211690823040:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:3.0:1787387839.451474:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787387839.451500:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7cf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52960 expref: 33 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.451522:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c7ccd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52959 expref: 32 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.451545:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c7c95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5294b expref: 31 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.451556:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:3.0:1787387839.451570:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387839.451598:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.451620:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.451630:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.451645:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7d0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.451651:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.451657:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.452107:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7d13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.452116:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7d13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.452123:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7d13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787387839.452963:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787387839.452975:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343902234845ns, next at 344902232626ns, rc = 0 00010000:00010000:3.0:1787387839.453520:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7d1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.453594:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7d1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.453614:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7d1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.453623:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7d1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.453630:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7d1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.453635:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7d1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.453660:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787387839.453682:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7d13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.453689:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7d13 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.453695:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7d13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.453701:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387839.453705:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7d13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.453713:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7d13 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.453728:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2df00) 00010000:00010000:3.0:1787387839.453730:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787387839.455394:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7d13 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.455407:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7d13 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.455438:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.455444:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.455450:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.455455:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387839.455458:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.455465:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.455477:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387839.455480:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387839.455483:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.455488:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787387839.455498:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c2e487b reply state 0000000017942d5c transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387839.455526:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787387839.455640:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+32:10475:x1874211690823040:12345-192.168.204.59@tcp:36:rm.0 Request processed in 4238us (4565us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787387839.455650:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 95 00010000:00010000:2.0:1787387839.455885:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387839.455893:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7d1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.455900:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387839.455904:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7d1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.455911:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7d1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.455921:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d4343c2df00) 00010000:00010000:2.0:1787387839.455923:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787387839.455926:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7d1a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.455932:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7d1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.455950:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387839.455952:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387839.455954:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387839.458888:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.458907:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7d0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.458914:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.458920:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152fc00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387839.458925:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.458932:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7d0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.458948:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c2d100) 00010000:00010000:1.0:1787387839.458951:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387839.458968:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7d0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.458975:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7d0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387839.531195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.531302:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690823296 00000100:00100000:2.0:1787387839.531312:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690823296 00000100:00100000:2.0:1787387839.531377:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:2.0:1787387839.531389:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+31:10481:x1874211690823296:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1787387839.531413:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387839.531452:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7d21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52967 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.532777:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.532798:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.532811:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.532827:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.532834:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.532841:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787387839.533426:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787387839.536928:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7d36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.536956:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7d36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.536969:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7d36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.537012:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.537037:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d28 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.537045:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.537052:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387839.537057:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.537065:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.537078:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:2.0:1787387839.537082:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387839.537097:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.537104:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787387839.537124:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a30163c reply state 00000000d4b1edff transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387839.537135:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787387839.537178:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7d21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52967 expref: 34 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.537193:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7d36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52967 expref: 33 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.537213:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:2.0:1787387839.537216:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787387839.537219:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fd200, rc 0) 00000100:00100000:2.0:1787387839.537311:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:10481:x1874211690823296:12345-192.168.204.59@tcp:101:bash.0 Request processed in 5925us (6127us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787387839.537322:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:2.0:1787387839.541796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:3.0:1787387839.542014:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.542027:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.542033:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.542040:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387839.542046:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.542054:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.542074:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d436f2f6a00) 00010000:00010000:3.0:1787387839.542077:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387839.542081:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.542097:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387839.542233:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690823424 00000100:00100000:1.0:1787387839.542246:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690823424 00000100:00100000:1.0:1787387839.542331:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:1.0:1787387839.542342:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2352:x1874211690823424:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1787387839.542362:0:6604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387839.542384:0:6604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7d44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5296e expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787387839.542412:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787387839.542431:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:1.0:1787387839.542436:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387839.542445:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7d44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5296e expref: 8 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.542463:0:6604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7d44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5296e expref: 8 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.542476:0:6604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5e00, rc 0) 00000100:00100000:1.0:1787387839.542540:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2352:x1874211690823424:12345-192.168.204.59@tcp:101:bash.0 Request processed in 200us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387839.542564:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00080000:2.0:1787387839.544167:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787387839.553200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387839.553415:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690823552 00000100:00100000:0.0:1787387839.553428:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690823552 00000100:00100000:0.0:1787387839.553494:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:0.0:1787387839.553505:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:10481:x1874211690823552:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1787387839.553524:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387839.553543:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52975 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.553576:0:6606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7d44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5296e expref: 9 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.553586:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787387839.553591:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387839.553597:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 9 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.553633:0:6606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7d44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5296e expref: 9 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.553648:0:6606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7d44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5296e expref: 9 pid: 6604 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387839.553663:0:6606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6606:1874211709718016:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387839.553783:0:6606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787387839.558077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.558183:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690823680 00000100:00100000:3.0:1787387839.558196:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690823680 00010000:00010000:3.0:1787387839.558246:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7d44 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5296e expref: 10 pid: 6604 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387839.558296:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:3.0:1787387839.558306:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:2351:x1874211690823680:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387839.558321:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387839.558346:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7d44 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5296e expref: 10 pid: 6604 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.558360:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7d44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5296e expref: 10 pid: 6604 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.558386:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387839.558390:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387839.558398:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 10 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.558410:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 10 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.558450:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 10 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387839.558465:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5794:1874211709718144:192.168.204.59@tcp:105: 00000100:00100000:3.0:1787387839.558553:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43452e46c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787387839.559792:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7d44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5296e expref: 10 pid: 6604 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387839.559832:0:6606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6606:1874211709718016:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387839.559860:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 9 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.559873:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71c00, rc 0) 00000100:00100000:0.0:1787387839.559918:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:10481:x1874211690823552:12345-192.168.204.59@tcp:101:bash.0 Request processed in 6415us (6731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387839.559926:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:3.0:1787387839.562392:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5794:1874211709718144:192.168.204.59@tcp:105: 00010000:00010000:3.0:1787387839.562431:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387839.562496:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2351:x1874211690823680:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 4191us (4428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387839.562508:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:1.0:1787387839.565634:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.565725:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690823936 00000100:00100000:3.0:1787387839.565735:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690823936 00000100:00100000:3.0:1787387839.565826:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:3.0:1787387839.565834:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+33:10481:x1874211690823936:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:3.0:1787387839.566241:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:10481:x1874211690823936:12345-192.168.204.59@tcp:35:bash.0 Request processed in 405us (616us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787387839.566250:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:1.0:1787387839.785052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.785181:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690824064 00000100:00100000:2.0:1787387839.785192:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690824064 00000100:00100000:2.0:1787387839.785259:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:2.0:1787387839.785271:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:10497:x1874211690824064:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1787387839.785297:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387839.785322:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5297c expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.785396:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7d59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.785411:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.785426:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387839.785487:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787387839.785491:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787387839.785534:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.785564:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5297c expref: 36 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.785584:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7d59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5297c expref: 35 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.785594:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:2.0:1787387839.785597:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787387839.785601:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fde00, rc 0) 00000100:00100000:2.0:1787387839.785669:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10497:x1874211690824064:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 400us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387839.785676:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:2.0:1787387839.791223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387839.791411:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690824320 00000100:00100000:0.0:1787387839.791423:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690824320 00000100:00100000:0.0:1787387839.791488:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:0.0:1787387839.791500:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:10497:x1874211690824320:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387839.791520:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387839.791553:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7d60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52983 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.791664:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7d67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.791681:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.791694:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387839.791706:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787387839.794606:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7d60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52983 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.794642:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52983 expref: 37 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.794653:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:0.0:1787387839.794655:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387839.794659:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70000, rc 0) 00000100:00100000:0.0:1787387839.794763:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+37:10497:x1874211690824320:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 3264us (3549us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787387839.794773:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:1.0:1787387839.809219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387839.809276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.809378:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690824704 00000100:00100000:2.0:1787387839.809391:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690824704 00000100:00100000:2.0:1787387839.809454:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:2.0:1787387839.809466:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+37:10497:x1874211690824704:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1787387839.809493:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387839.809519:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5298a expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.809638:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.809654:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.809684:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387839.809699:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787387839.809886:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7d75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5298a expref: 40 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.809908:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5298a expref: 39 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.809918:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:2.0:1787387839.809921:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787387839.809924:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fc600, rc 0) 00000100:00100000:2.0:1787387839.809989:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+39:10497:x1874211690824704:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 526us (712us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787387839.809997:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:0.0:1787387839.810147:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690824448 00000100:00100000:0.0:1787387839.810153:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690824448 00000100:00100000:0.0:1787387839.810196:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1787387839.810205:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+39:2351:x1874211690824448:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387839.810215:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387839.810231:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7d67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52983 expref: 39 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.810243:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:0.0:1787387839.810246:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387839.810268:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+38:2351:x1874211690824448:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 65us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387839.810275:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1787387839.819701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387839.819876:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690824832 00000100:00100000:0.0:1787387839.819896:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690824832 00000100:00100000:0.0:1787387839.819971:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:0.0:1787387839.819994:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2351:x1874211690824832:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:0.0:1787387839.820043:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.820067:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 8 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.820075:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387839.820089:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787387839.820094:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.820139:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 8 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.820153:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 8 pid: 6606 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387839.820168:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1874211709718272:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387839.820270:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387839.826815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.826916:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690824960 00000100:00100000:2.0:1787387839.826927:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690824960 00002000:00100000:2.0:1787387839.826980:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d437a74a300 x1874211690824960/t0(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:95/0 lens 504/0 e 0 to 0 dl 1787387850 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787387839.827001:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d437a74a300 with x1874211690824960 ext(0->8) 00010000:00010000:2.0:1787387839.827012:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 9 pid: 6606 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.827030:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 9 pid: 6606 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787387839.827059:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d437a74a300 00000100:00100000:2.0:1787387839.827104:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:2.0:1787387839.827115:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2350:x1874211690824960:12345-192.168.204.59@tcp:4:lfs.0 00000100:00100000:2.0:1787387839.827656:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:2350:x1874211690824960:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 541us (850us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787387839.827666:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00002000:00100000:2.0:1787387839.827675:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d437a74a300 x1874211690824960/t4294967302(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:95/0 lens 504/448 e 0 to 0 dl 1787387850 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787387839.827684:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d437a74a300 with x1874211690824960 ext(0->8) 00010000:00010000:2.0:1787387839.827691:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 11 pid: 6606 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.827704:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 11 pid: 6606 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787387839.827712:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d437a74a300 00000100:00100000:0.0:1787387839.829152:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1874211709718272:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387839.829183:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.839119:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387839.846549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387839.846793:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690825088 00000100:00100000:2.0:1787387839.846804:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690825088 00010000:00010000:2.0:1787387839.846846:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 11 pid: 6606 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387839.846899:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:2.0:1787387839.846909:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:2351:x1874211690825088:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387839.846940:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787387839.846973:0:5793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787387839.846977:0:5793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787387839 00002000:00010000:2.0:1787387839.846985:0:5793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787387839 00002000:00010000:2.0:1787387839.846988:0:5793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787387839 00010000:00010000:2.0:1787387839.846996:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 11 pid: 6606 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.847012:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 11 pid: 6606 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.847037:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf7c251d/0x93d41aeaa23c7d4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52975 expref: 11 pid: 6606 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.847054:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387839.847058:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387839.847064:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.847075:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387839.847124:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387839.847188:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:2351:x1874211690825088:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 280us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387839.847197:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00010000:00010000:1.0:1787387839.848115:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.848132:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.848166:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.848176:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.848185:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.848192:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387839.848198:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.848224:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.848240:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387839.848249:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b98efa98/0x93d41aeaa23c7d8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387839.848347:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2351:x1874211690824832:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 28362us (28652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387839.848356:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:1.0:1787387839.866964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.868539:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690825344 00000100:00100000:3.0:1787387839.868557:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690825344 00000100:00100000:3.0:1787387839.868638:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:3.0:1787387839.868650:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4365679c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+38:10497:x1874211690825344:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:3.0:1787387839.868766:0:5811:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5298a expref: 38 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787387839.869254:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787387839.869301:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787387839.869639:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787387839.870170:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.870192:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7d36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52967 expref: 42 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.870216:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.870254:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7d36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52967 expref: 42 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.870270:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7d36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52967 expref: 42 pid: 5808 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387839.870285:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5811:1874211709718400:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387839.870383:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374241540 going to sleep for 11 seconds 00000100:00100000:2.0:1787387839.876277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387839.876586:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690825472 00000100:00100000:0.0:1787387839.876613:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690825472 00010000:00010000:0.0:1787387839.876657:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7d36 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52967 expref: 43 pid: 5808 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387839.876708:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:0.0:1787387839.876719:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+43:2350:x1874211690825472:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387839.876735:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387839.876783:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7d36 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52967 expref: 43 pid: 5808 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.876798:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7d36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52967 expref: 43 pid: 5808 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.876818:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:0.0:1787387839.876824:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.876833:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.876841:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.876861:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387839.876925:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+43:2350:x1874211690825472:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 208us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387839.876933:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00010000:00010000:3.0:1787387839.878116:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7d36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52967 expref: 42 pid: 5808 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387839.878142:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5811:1874211709718400:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387839.878165:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.878175:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.878181:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787387839.878332:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787387839.878553:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787387839.878664:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1874211709718528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787387839.880116:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387839.880162:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374241cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387839.880219:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709718528 00000100:00100000:2.0:1787387839.880229:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709718528 00000100:00100000:2.0:1787387839.880287:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387839.880298:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5811:x1874211709718528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787387839.880391:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5811:x1874211709718528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387839.880398:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387839.881595:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1874211709718528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787387839.882365:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787387839.882441:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1874211709718656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787387839.882492:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387839.882529:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374241540 going to sleep for 11 seconds 00000100:00100000:2.0:1787387839.882635:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709718656 00000100:00100000:2.0:1787387839.882642:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709718656 00000100:00100000:2.0:1787387839.882689:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787387839.882698:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5811:x1874211709718656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787387839.882897:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5811:x1874211709718656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 199us (403us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787387839.882904:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387839.885537:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1874211709718656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787387839.885663:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787387839.887263:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.887279:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.887286:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.887292:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387839.887297:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.887304:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.887320:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:3.0:1787387839.887323:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787387839.887327:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387839.887347:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7d91 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787387839.887564:0:5811:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787387839.887673:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787387839.887685:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344336945142ns, next at 345336942738ns, rc = 0 00000001:00080000:3.0:1787387839.887692:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787387839.887728:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:3.0:1787387839.887731:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787387839.887775:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7d7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5298a expref: 46 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387839.893147:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4365679c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+45:10497:x1874211690825344:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 24487us (26183us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787387839.893161:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000020:00080000:3.0:1787387839.893167:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787387839.900323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387839.900473:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690825600 00000100:00100000:0.0:1787387839.900484:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690825600 00000100:00100000:0.0:1787387839.900564:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:0.0:1787387839.900576:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+45:10497:x1874211690825600:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387839.900604:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387839.900629:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7d98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52991 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.901116:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7d98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52991 expref: 46 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.901134:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7d98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52991 expref: 46 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387839.901156:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387839.901158:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787387839.901162:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70e00, rc 0) 00000100:00100000:0.0:1787387839.901217:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+46:10497:x1874211690825600:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 644us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387839.901224:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:1.0:1787387839.922629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387839.922689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387839.922783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387839.922814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387839.923067:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690825984 00000100:00100000:3.0:1787387839.923088:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690825984 00000100:00100000:3.0:1787387839.923148:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 293 00000100:00100000:3.0:1787387839.923159:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690825984:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387839.923234:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690825984:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 78us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387839.923243:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 293 00000100:00100000:2.0:1787387839.923343:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690826112 00000100:00100000:2.0:1787387839.923348:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690826112 00000100:00100000:2.0:1787387839.923397:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:2.0:1787387839.923405:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690826112:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387839.923438:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690826112:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 35us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387839.923445:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:2.0:1787387839.923548:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690826240 00000100:00100000:2.0:1787387839.923552:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690826240 00000100:00080000:2.0:1787387839.923573:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387839.923600:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 149 00000100:00100000:2.0:1787387839.923616:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690826240:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387839.923666:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690826240:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 51us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387839.923673:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 149 00000100:00100000:0.0:1787387839.924141:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690825856 00000100:00100000:0.0:1787387839.924148:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690825856 00000100:00100000:0.0:1787387839.924181:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:0.0:1787387839.924188:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+46:10497:x1874211690825856:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1787387839.924403:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+47:10497:x1874211690825856:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 215us (1785us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787387839.924411:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:2.0:1787387840.026104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.026246:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690826368 00000100:00100000:0.0:1787387840.026258:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690826368 00000100:00100000:0.0:1787387840.026350:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:0.0:1787387840.026362:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+47:10507:x1874211690826368:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1787387840.026449:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7d9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026469:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7d9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026481:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7d9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026496:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7da6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026502:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026507:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026628:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7dad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026636:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026642:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787387840.026682:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026694:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7d9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026706:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7d9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026711:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7d9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026717:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387840.026721:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7d9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026728:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7d9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026789:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:0.0:1787387840.026793:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387840.026799:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7d9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026805:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7d9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026820:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026826:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7da6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026833:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026837:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387840.026848:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026854:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7da6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026862:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c46400) 00010000:00010000:0.0:1787387840.026865:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387840.026868:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7da6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026873:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7da6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026888:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026894:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7dad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026900:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7dad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026907:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387840.026909:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7dad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026915:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7dad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026921:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387840.026924:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387840.026932:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7dad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.026937:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7dad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387840.027019:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+47:10507:x1874211690826368:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 659us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387840.027027:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00080000:2.0:1787387840.027316:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387840.083103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.083255:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690826624 00000100:00100000:0.0:1787387840.083265:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690826624 00000100:00100000:0.0:1787387840.083324:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:0.0:1787387840.083333:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+47:10510:x1874211690826624:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387840.083354:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387840.083376:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7db4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52998 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083449:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7dbb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083463:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7dbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083475:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7dbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083490:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7dc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083497:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083534:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083667:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7dc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083676:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083683:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387840.083693:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787387840.083840:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7dbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083848:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7dbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083854:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7dbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083860:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387840.083865:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7dbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083873:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7dbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083885:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:0.0:1787387840.083888:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387840.083899:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7dbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083909:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7dbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083922:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083928:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7dc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083934:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083939:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387840.083942:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083948:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7dc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083956:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c46400) 00010000:00010000:0.0:1787387840.083959:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387840.083961:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7dc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.083967:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7dc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.084139:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7db4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52998 expref: 50 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.084156:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52998 expref: 49 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.084163:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:1.0:1787387840.084166:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787387840.084175:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70800, rc 0) 00000100:00100000:1.0:1787387840.085062:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+49:10510:x1874211690826624:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1725us (1980us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787387840.085083:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:1.0:1787387840.090589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.090677:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690826752 00000100:00100000:0.0:1787387840.090688:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690826752 00000100:00100000:0.0:1787387840.090788:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:0.0:1787387840.090814:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+49:10510:x1874211690826752:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1787387840.090884:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7dd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.090903:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.090916:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.090948:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.090955:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7dd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.090963:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.090969:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387840.090986:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.090995:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7dd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.091008:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387840.091011:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787387840.091016:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7dd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.091023:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7dd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387840.091127:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+49:10510:x1874211690826752:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 315us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387840.091136:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:2.0:1787387840.095586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.095702:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690827008 00000100:00100000:0.0:1787387840.095713:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690827008 00000100:00100000:0.0:1787387840.095791:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:0.0:1787387840.095802:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+49:10510:x1874211690827008:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1787387840.096059:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+50:10510:x1874211690827008:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 259us (486us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787387840.096722:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:2.0:1787387840.241838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.241928:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690827264 00000100:00100000:3.0:1787387840.241938:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690827264 00000100:00100000:3.0:1787387840.242015:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:3.0:1787387840.242025:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+50:10520:x1874211690827264:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1787387840.242064:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387840.242066:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787387840.242327:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7d59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5297c expref: 50 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.242349:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387840.242354:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387840.242370:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7dde lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b5299f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.242487:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.242500:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.242511:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387840.242592:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787387840.242726:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7dde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5299f expref: 52 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.242790:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5299f expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.242798:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:3.0:1787387840.242801:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387840.242804:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e800, rc 0) 00000100:00100000:3.0:1787387840.242879:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+51:10520:x1874211690827264:12345-192.168.204.59@tcp:101:bash.0 Request processed in 854us (1049us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787387840.242888:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:1.0:1787387840.252380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.252485:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690827520 00000100:00100000:0.0:1787387840.252496:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690827520 00000100:00100000:0.0:1787387840.252565:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:0.0:1787387840.252575:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+51:10520:x1874211690827520:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:0.0:1787387840.252634:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787387840.252659:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7de5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5299f expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.252681:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7dc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52998 expref: 50 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.252693:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387840.252698:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387840.252946:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.253256:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.253269:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387840.253324:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787387840.253349:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048e4f2a1 reply state 000000008ce4dd9a transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387840.253357:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387840.253457:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:10520:x1874211690827520:12345-192.168.204.59@tcp:36:bash.0 Request processed in 882us (1085us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787387840.253464:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 105 00000020:00080000:0.0:1787387840.253470:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787387840.256890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.257135:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690827648 00000100:00100000:3.0:1787387840.257145:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690827648 00000100:00100000:3.0:1787387840.257189:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00100000:3.0:1787387840.257199:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:10520:x1874211690827648:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1787387840.257222:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387840.257241:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7dfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529a6 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.257317:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.257330:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.257337:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.257352:0:6840:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.257362:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.257693:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.257701:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.257708:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.257714:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387840.257717:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.257724:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.257759:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:1.0:1787387840.257762:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387840.257765:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.257772:0:3297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.257779:0:3297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.257818:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.257824:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7df3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.257883:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.257890:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387840.257921:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787387840.257925:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387840.257941:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.257967:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7dfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529a6 expref: 53 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.257992:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529a6 expref: 52 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.258007:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387840.258010:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387840.258013:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152ee00, rc 0) 00000100:00100000:0.0:1787387840.258082:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:10520:x1874211690827648:12345-192.168.204.59@tcp:101:bash.0 Request processed in 873us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387840.258090:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00100000:2.0:1787387840.261716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.261885:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690827904 00000100:00100000:3.0:1787387840.261895:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690827904 00000100:00100000:3.0:1787387840.261963:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:3.0:1787387840.261981:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:10520:x1874211690827904:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:3.0:1787387840.262242:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+53:10520:x1874211690827904:12345-192.168.204.59@tcp:35:bash.0 Request processed in 270us (535us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787387840.262249:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:1.0:1787387840.336019:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.336124:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690828032 00000100:00100000:3.0:1787387840.336135:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690828032 00000100:00100000:3.0:1787387840.336196:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:3.0:1787387840.336206:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+53:10526:x1874211690828032:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387840.336231:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387840.336254:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7e08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529ad expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.336322:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7e0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.336338:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.336351:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387840.336426:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787387840.336431:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387840.336456:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.336481:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7e08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ad expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.336498:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7e0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ad expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.336532:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387840.336535:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387840.336539:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e600, rc 0) 00000100:00100000:3.0:1787387840.336602:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:10526:x1874211690828032:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 397us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387840.336609:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:2.0:1787387840.340997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.341099:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690828160 00000100:00100000:0.0:1787387840.341110:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690828160 00000100:00100000:0.0:1787387840.341173:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:0.0:1787387840.341183:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:10526:x1874211690828160:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387840.341203:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387840.341225:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7e16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529b4 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341291:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7e1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341307:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7e1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341318:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7e1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341332:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7e24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341338:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341364:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341469:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341478:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341484:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387840.341534:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787387840.341539:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387840.341559:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341571:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341579:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7e1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341585:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7e1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341592:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7e1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341597:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387840.341602:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7e1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341615:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7e1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341627:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:0.0:1787387840.341629:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387840.341633:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7e1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341639:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7e1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341652:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341657:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7e24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341663:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7e24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341667:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387840.341670:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7e24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341676:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7e24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341682:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c46400) 00010000:00010000:0.0:1787387840.341684:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387840.341686:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7e24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341700:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7e24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.341729:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7e16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529b4 expref: 56 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.342090:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529b4 expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.342100:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387840.342103:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387840.342105:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70a00, rc 0) 00000100:00100000:0.0:1787387840.342206:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:10526:x1874211690828160:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1023us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387840.342214:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:2.0:1787387840.346270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387840.346342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.346405:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690828544 00000100:00100000:0.0:1787387840.346415:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690828544 00000100:00100000:0.0:1787387840.346472:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:0.0:1787387840.346482:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:2353:x1874211690828544:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387840.346496:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387840.346529:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529b4 expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.346548:0:11042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387840.346553:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387840.346613:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:2353:x1874211690828544:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 132us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387840.346632:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1787387840.347895:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690828416 00000100:00100000:3.0:1787387840.347906:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690828416 00000100:00100000:3.0:1787387840.347993:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:3.0:1787387840.348003:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:10526:x1874211690828416:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387840.348022:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387840.348039:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7e32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529bb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.348139:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.348152:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529a6 expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.348161:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.348208:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529a6 expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.348221:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529a6 expref: 55 pid: 6840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387840.348245:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2df480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709718784:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387840.348334:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43742413c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387840.351889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.351998:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2df480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709718784:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387840.352027:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387840.352114:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690828672 00000100:00100000:0.0:1787387840.352122:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690828672 00010000:00010000:0.0:1787387840.352163:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529a6 expref: 56 pid: 6840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387840.352413:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1787387840.352423:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:2350:x1874211690828672:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387840.352436:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387840.352444:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529a6 expref: 56 pid: 6840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.352455:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529a6 expref: 56 pid: 6840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.352477:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7e01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529a6 expref: 56 pid: 6840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.352494:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387840.352498:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.352507:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.352525:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.352574:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387840.352672:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:2350:x1874211690828672:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 251us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387840.352680:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00010000:00010000:2.0:1787387840.352918:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.352925:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387840.352944:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787387840.353112:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c7e32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529bb expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.353128:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529bb expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.353146:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:2.0:1787387840.353149:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787387840.353151:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e800, rc 0) 00000100:00100000:2.0:1787387840.353196:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:10526:x1874211690828416:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 5195us (6935us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787387840.353203:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:1.0:1787387840.356654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.356839:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690828928 00000100:00100000:0.0:1787387840.356850:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690828928 00000100:00100000:0.0:1787387840.356942:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:0.0:1787387840.356953:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:10526:x1874211690828928:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:0.0:1787387840.357038:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387840.357063:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7d98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52991 expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.357093:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387840.357097:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387840.357157:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:10526:x1874211690828928:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 205us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387840.357163:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:1.0:1787387840.359185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387840.359263:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690829056 00000100:00100000:2.0:1787387840.359273:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690829056 00000100:00100000:2.0:1787387840.359340:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:2.0:1787387840.359350:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:10526:x1874211690829056:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:2.0:1787387840.359480:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.359499:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.359510:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787387840.359719:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787387840.359829:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:10526:x1874211690829056:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 481us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387840.359837:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:1.0:1787387840.362304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387840.362390:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690829184 00000100:00100000:2.0:1787387840.362402:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690829184 00000100:00100000:2.0:1787387840.362462:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 111 00000100:00100000:2.0:1787387840.362473:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:10526:x1874211690829184:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1787387840.362508:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387840.362544:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7e4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529c2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.362602:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.362613:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7e4e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529c2 expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.362632:0:5808:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.362645:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7e4e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529c2 expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.362658:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:2.0:1787387840.362661:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387840.362665:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7e4e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529c2 expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.362673:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fde00, rc 0) 00000100:00100000:2.0:1787387840.362731:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:10526:x1874211690829184:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 260us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387840.362762:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 111 00000040:00080000:2.0:1787387840.734146:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387840.734156:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787387840.734197:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787387840.734210:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787387840.734353:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709718912:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787387840.734467:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387840.748034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387840.748179:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709718912:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787387840.748461:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690829312 00000100:00100000:3.0:1787387840.748469:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690829312 00000100:00100000:3.0:1787387840.748541:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 112 00000100:00100000:3.0:1787387840.748552:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:10527:x1874211690829312:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787387840.748585:0:5809:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787387840.748728:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:10527:x1874211690829312:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 178us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387840.748766:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 112 00000100:00100000:1.0:1787387840.755646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387840.755773:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690829440 00000100:00100000:2.0:1787387840.755784:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690829440 00000100:00100000:2.0:1787387840.755852:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 113 00000100:00100000:2.0:1787387840.755863:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:10527:x1874211690829440:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787387840.755938:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7e55 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.755955:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7e55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.755968:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7e55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756053:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7e5c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756071:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7e5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756079:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7e5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756102:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756111:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756132:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387840.756173:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787387840.756177:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787387840.756189:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756200:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7e55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756206:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7e55 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756212:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7e55 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756218:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fda00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387840.756221:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7e55 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756228:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7e55 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756239:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:2.0:1787387840.756242:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387840.756247:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7e55 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756252:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c7e55 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756276:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7e5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756282:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7e5c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756286:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7e5c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756291:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387840.756294:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7e5c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756299:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7e5c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756307:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8d436f2f6800) 00010000:00010000:2.0:1787387840.756309:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387840.756311:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7e5c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756316:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c7e5c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756332:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756338:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7e63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756343:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756353:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387840.756356:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756361:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7e63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756369:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:2.0:1787387840.756372:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387840.756374:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7e63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.756379:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7e63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387840.756563:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:10527:x1874211690829440:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 701us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387840.756571:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 113 00000100:00100000:1.0:1787387840.763241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.763336:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690829696 00000100:00100000:3.0:1787387840.763348:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690829696 00000100:00100000:3.0:1787387840.763411:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00100000:3.0:1787387840.763421:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:10527:x1874211690829696:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387840.763448:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387840.763469:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7e6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529c9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763571:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763616:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763629:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387840.763644:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787387840.763802:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763810:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763817:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763824:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387840.763829:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763837:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763850:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:3.0:1787387840.763854:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787387840.763859:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763866:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763907:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7e6a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529c9 expref: 57 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763925:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:3.0:1787387840.763928:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787387840.763933:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7e6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529c9 expref: 57 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.763944:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152fc00, rc 0) 00000100:00100000:3.0:1787387840.763998:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:10527:x1874211690829696:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 578us (766us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1787387840.764005:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00100000:1.0:1787387840.770451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.770569:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690829824 00000100:00100000:0.0:1787387840.770583:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690829824 00000100:00100000:0.0:1787387840.770654:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:0.0:1787387840.770663:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:10527:x1874211690829824:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787387840.770704:0:5807:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787387840.770846:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:10527:x1874211690829824:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 183us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387840.770854:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:1.0:1787387840.778030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.778182:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690830080 00000100:00100000:3.0:1787387840.778192:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690830080 00000100:00100000:3.0:1787387840.778255:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00100000:3.0:1787387840.778266:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:10527:x1874211690830080:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387840.778287:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387840.778290:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787387840.778319:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7e0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ad expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.778339:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387840.778349:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387840.778363:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7e7f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787387840.778844:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787387840.779198:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.779224:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.779235:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.779294:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7e7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d0 expref: 58 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.779313:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d0 expref: 57 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.779322:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:3.0:1787387840.779325:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387840.779328:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f400, rc 0) 00000100:00100000:3.0:1787387840.779404:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:10527:x1874211690830080:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1140us (1383us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787387840.779413:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00100000:1.0:1787387840.788496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.788872:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690830336 00000100:00100000:0.0:1787387840.788883:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690830336 00000100:00100000:0.0:1787387840.788948:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 117 00000100:00100000:0.0:1787387840.788960:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:10527:x1874211690830336:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787387840.789150:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387840.789179:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7e86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d0 expref: 57 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789198:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2de00) 00010000:00010000:0.0:1787387840.789209:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387840.789231:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7e94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789245:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7e94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789255:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7e94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789270:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa50fe93e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789277:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa50fe93e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789284:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa50fe93e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789360:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7e94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789388:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7e94 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789396:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7e94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789402:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387840.789407:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7e94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789414:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7e94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789423:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:0.0:1787387840.789426:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387840.789429:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7e94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789436:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c7e94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789446:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa50fe93e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789453:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa50fe93e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789458:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa50fe93e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789463:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387840.789473:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa50fe93e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789480:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa50fe93e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789489:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa50fe93e (ffff8d4343c46400) 00010000:00010000:0.0:1787387840.789491:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387840.789494:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa50fe93e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.789500:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7e9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa50fe93e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387840.790287:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:10527:x1874211690830336:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1324us (1796us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787387840.793897:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 117 00000100:00100000:2.0:1787387840.798167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.798552:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690830464 00000100:00100000:3.0:1787387840.798567:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690830464 00000100:00100000:3.0:1787387840.798625:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 118 00000100:00100000:3.0:1787387840.798635:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:10527:x1874211690830464:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387840.798664:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387840.798688:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ea2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529d7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.798724:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7ea9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.798766:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.798777:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.798886:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ea2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d7 expref: 58 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.798906:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d7 expref: 57 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.798914:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2d600) 00010000:00010000:3.0:1787387840.798918:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787387840.798921:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e600, rc 0) 00000100:00100000:3.0:1787387840.799046:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:10527:x1874211690830464:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 412us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387840.799054:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 118 00000100:00100000:2.0:1787387840.808492:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.808625:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690830720 00000100:00100000:0.0:1787387840.808635:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690830720 00000100:00100000:0.0:1787387840.808698:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00100000:0.0:1787387840.808709:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:10527:x1874211690830720:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787387840.808826:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.808844:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387840.808855:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787387840.809141:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787387840.809166:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345258426476ns, next at 346258423806ns, rc = 0 00000004:00010000:0.0:1787387840.809250:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d40fcf28 reply state 00000000dc69ebe3 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387840.809260:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387840.809347:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:10527:x1874211690830720:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 639us (863us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787387840.809356:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 119 00010000:00010000:3.0:1787387840.812135:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.812154:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.812162:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.812169:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387840.812174:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.812196:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.812214:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2d600) 00010000:00010000:3.0:1787387840.812217:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787387840.812221:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.812228:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387840.813197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.813504:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690830848 00000100:00100000:3.0:1787387840.813518:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690830848 00000100:00100000:3.0:1787387840.813574:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:3.0:1787387840.813585:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+58:10527:x1874211690830848:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387840.813609:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387840.813627:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7eb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.813680:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529de expref: 59 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.813695:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529de expref: 59 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.813714:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2d600) 00010000:00010000:3.0:1787387840.813717:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787387840.813720:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f400, rc 0) 00000100:00100000:3.0:1787387840.813816:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:10527:x1874211690830848:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 232us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387840.813824:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:2.0:1787387840.817192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.817295:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690830976 00000100:00100000:3.0:1787387840.817306:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690830976 00000100:00100000:3.0:1787387840.817415:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:3.0:1787387840.817426:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2351:x1874211690830976:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787387840.817781:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2351:x1874211690830976:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 355us (597us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787387840.817790:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00080000:2.0:1787387840.818960:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387840.820517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.820591:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690831232 00000100:00100000:3.0:1787387840.820601:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690831232 00000100:00100000:3.0:1787387840.820660:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:3.0:1787387840.820670:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:10527:x1874211690831232:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787387840.820959:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:10527:x1874211690831232:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 290us (459us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787387840.820968:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:0.0:1787387840.823524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387840.823627:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690831488 00000100:00100000:2.0:1787387840.823636:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690831488 00000100:00100000:2.0:1787387840.823689:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:2.0:1787387840.823700:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:10527:x1874211690831488:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787387840.823841:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:10527:x1874211690831488:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 143us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387840.823861:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:2.0:1787387840.826815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.827210:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690831616 00000100:00100000:3.0:1787387840.827221:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690831616 00000100:00100000:3.0:1787387840.827287:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:3.0:1787387840.827298:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:10527:x1874211690831616:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387840.827322:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387840.827345:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ebe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529e5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.827421:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ec5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.827445:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.827458:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387840.827501:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387840.827532:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.827561:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c7ebe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529e5 expref: 62 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.827579:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529e5 expref: 61 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.827589:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2d600) 00010000:00010000:3.0:1787387840.827592:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787387840.827596:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152ee00, rc 0) 00000100:00100000:3.0:1787387840.827664:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:10527:x1874211690831616:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 368us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387840.827673:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:1.0:1787387840.830716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387840.830902:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690831744 00000100:00100000:2.0:1787387840.830912:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690831744 00000100:00100000:2.0:1787387840.830966:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:2.0:1787387840.830976:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2350:x1874211690831744:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787387840.831000:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387840.831021:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c7ecc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529ec expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787387840.831045:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a895fc0, blocks: 0x1 00010000:00010000:2.0:1787387840.831072:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1787387840.831077:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387840.831086:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c7ecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ec expref: 10 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.831104:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c7ecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ec expref: 10 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.831117:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fda00, rc 0) 00000100:00100000:2.0:1787387840.831178:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:2350:x1874211690831744:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 203us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387840.831186:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:2.0:1787387840.833993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387840.834212:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690832000 00000100:00100000:0.0:1787387840.834222:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690832000 00000100:00100000:0.0:1787387840.834284:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:0.0:1787387840.834294:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:10527:x1874211690832000:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787387840.834410:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:10527:x1874211690832000:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 118us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387840.834419:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:1.0:1787387840.837322:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.837481:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690832128 00000100:00100000:3.0:1787387840.837492:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690832128 00000100:00100000:3.0:1787387840.837558:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:3.0:1787387840.837569:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:10527:x1874211690832128:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387840.837587:0:11067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387840.837623:0:11067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529f3 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.837659:0:11067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c7ecc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ec expref: 11 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.837669:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387840.837674:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387840.837680:0:11067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 11 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.837713:0:11067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c7ecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ec expref: 11 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.837726:0:11067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c7ecc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ec expref: 11 pid: 6605 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387840.837786:0:11067:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11067:1874211709719040:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387840.837884:0:11067:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43742413c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387840.841485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387840.841605:0:11067:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11067:1874211709719040:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387840.841640:0:11067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 11 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.841662:0:11067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152fc00, rc 0) 00000100:00100000:3.0:1787387840.841733:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:10527:x1874211690832128:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 4164us (4419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387840.841812:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:2.0:1787387840.842478:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690832256 00000100:00100000:2.0:1787387840.842494:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690832256 00010000:00010000:2.0:1787387840.842529:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c7ecc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ec expref: 11 pid: 6605 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387840.842564:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:2.0:1787387840.842573:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:2351:x1874211690832256:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387840.842586:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387840.842607:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c7ecc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ec expref: 11 pid: 6605 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.842620:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c7ecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ec expref: 11 pid: 6605 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.842644:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c7ecc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529ec expref: 11 pid: 6605 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.842658:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387840.842663:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387840.842671:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 10 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.842683:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 10 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.842719:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 10 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387840.842795:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5793:1874211709719168:192.168.204.59@tcp:105: 00000100:00100000:2.0:1787387840.842869:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387840.846722:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5793:1874211709719168:192.168.204.59@tcp:105: 00010000:00010000:2.0:1787387840.846919:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387840.847174:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:2351:x1874211690832256:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 4590us (5691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387840.847187:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:1.0:1787387840.850667:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387840.851372:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690832384 00000100:00100000:2.0:1787387840.851384:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690832384 00002000:00100000:2.0:1787387840.851437:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d437f7dad80 x1874211690832384/t0(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:96/0 lens 504/0 e 0 to 0 dl 1787387851 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787387840.851448:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d437f7dad80 with x1874211690832384 ext(0->12) 00002000:00010000:2.0:1787387840.851454:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d437f7dad80 00000100:00100000:2.0:1787387840.851493:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:2.0:1787387840.851502:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:2351:x1874211690832384:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787387840.852341:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+12:2351:x1874211690832384:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 837us (1680us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787387840.852352:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00002000:00100000:2.0:1787387840.852361:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d437f7dad80 x1874211690832384/t4294967308(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:96/0 lens 504/448 e 0 to 0 dl 1787387851 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787387840.852371:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d437f7dad80 with x1874211690832384 ext(0->12) 00002000:00010000:2.0:1787387840.852375:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d437f7dad80 00000100:00100000:3.0:1787387840.855293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387840.855406:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690832512 00000100:00100000:2.0:1787387840.855416:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690832512 00000100:00100000:2.0:1787387840.855473:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:2.0:1787387840.855483:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:10527:x1874211690832512:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1787387840.866326:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787387840.955336:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1787387840.955349:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:1.0:1787387840.959730:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709719296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787387840.959833:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387840.961798:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709719424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787387840.961874:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387840.962181:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709719296 00000100:00100000:3.0:1787387840.962191:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709719296 00000100:00100000:3.0:1787387840.962262:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709719424 00000100:00100000:3.0:1787387840.962265:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709719424 00000100:00100000:3.0:1787387840.962286:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787387840.962294:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1874211709719296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787387840.962323:0:6605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1787387840.962347:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.962369:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010fc1935/0x93d41aeaa23c7c9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52952 expref: 11 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.962377:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787387840.962381:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787387840.962386:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.962417:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010fc1935/0x93d41aeaa23c7c9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52952 expref: 11 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.962432:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010fc1935/0x93d41aeaa23c7c9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52952 expref: 11 pid: 6606 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387840.962466:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6605:1874211709719552:192.168.204.59@tcp:104: 00000100:00080000:0.0:1787387840.962600:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387840.962671:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43438de9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387840.962689:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787387840.962698:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1874211709719424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787387840.962893:0:11067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787387840.962897:0:11067:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787387841 00002000:00010000:3.0:1787387840.962900:0:11067:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787387840.962902:0:11067:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787387840 -> 1787387841 00002000:00010000:3.0:1787387840.962904:0:11067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787387840.962948:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3311:x1874211709719424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 252us (1075us total) trans 4294967309 rc 0/0 00000004:00080000:0.0:1787387840.963145:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d437f6ce680/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787387840.963153:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709719424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787387840.966278:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000020:00080000:3.0:1787387840.969551:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d43457c63c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787387840.969565:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d4345c18500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d43457c6d80 00000020:00080000:3.0:1787387840.969569:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d4345c18100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d4346556000 00000001:00080000:3.0:1787387840.969596:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787387840.969613:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787387840.969632:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d4374241cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787387840.969635:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d4347d5aa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d4374241e40 00000020:00080000:3.0:1787387840.969638:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d4374270800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d437a74d000 00000004:00080000:3.0:1787387840.969658:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787387840.969792:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787387840.970048:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787387840.970597:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387840.970620:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709719680:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787387840.970710:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387840.970933:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709719680 00000100:00100000:3.0:1787387840.970941:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709719680 00000100:00080000:1.0:1787387840.972255:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387840.972451:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787387840.972468:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3311:x1874211709719680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787387840.972510:0:11067:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1787387840.972551:0:11067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a895fbf, atime: 0x6a895fbf, ctime: 0x6a895fbf, blocks: 0x1 00010000:00010000:3.0:1787387840.972559:0:11067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c7ee1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.972573:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1787387840.972577:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387840.972583:0:11067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c7ee1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.972600:0:11067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c7ee1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.972610:0:11067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c7ee1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.972617:0:11067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c7ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387840.972637:0:11067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787387840.973529:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3311:x1874211709719680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1066us (2816us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787387840.973539:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787387840.976822:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:10527:x1874211690832512:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 121327us (121526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387840.976837:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 124 00010000:00010000:2.0:1787387840.976890:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387840.976899:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c7ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.976912:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030a00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387840.976916:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c7ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.976927:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c7ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.976945:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c7ee1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.976953:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c7ee1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.977139:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387840.977142:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387840.977144:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787387840.977248:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d437f6cc000/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787387840.977256:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709719680:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787387840.979445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387840.979671:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6605:1874211709719552:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387840.979700:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387840.979791:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690832640 00000100:00100000:1.0:1787387840.979799:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690832640 00010000:00010000:1.0:1787387840.979837:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010fc1935/0x93d41aeaa23c7c9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52952 expref: 12 pid: 6606 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387840.979873:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1787387840.979882:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+12:2350:x1874211690832640:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787387840.979898:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387840.979904:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010fc1935/0x93d41aeaa23c7c9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52952 expref: 12 pid: 6606 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.979916:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010fc1935/0x93d41aeaa23c7c9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52952 expref: 12 pid: 6606 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.979940:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010fc1935/0x93d41aeaa23c7c9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52952 expref: 12 pid: 6606 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.979965:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787387840.979970:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787387840.979975:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.980079:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.980102:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387840.980150:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:2350:x1874211690832640:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 268us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387840.980158:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00010000:00010000:2.0:1787387840.980306:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.980314:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.980324:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.980331:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387840.980347:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787387840.981286:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387840.981296:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.981306:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387840.981311:0:11539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.981321:0:11539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.981337:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.981344:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000439be306/0x93d41aeaa23c7eda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387840.981362:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387840.981372:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387840.981374:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387840.981439:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3314:x1874211709719296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19144us (21604us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787387840.981449:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1787387840.981612:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d437f6ce300/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787387840.981619:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709719296:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787387840.984641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387840.988613:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690832768 00000100:00100000:1.0:1787387840.988630:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690832768 00000100:00100000:1.0:1787387840.988822:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:1.0:1787387840.988835:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:2350:x1874211690832768:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787387841.043398:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1787387841.043422:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1787387841.043427:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1787387841.043600:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690832768:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 54763us (58963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387841.043612:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:3.0:1787387841.045527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387841.045649:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690833024 00000100:00100000:0.0:1787387841.045670:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690833024 00000100:00100000:0.0:1787387841.045723:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:0.0:1787387841.045733:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:10527:x1874211690833024:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787387841.045807:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387841.045834:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152ee00/0x93d41aeaa23c7ec5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529e5 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.045854:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2d600) 00010000:00010000:0.0:1787387841.045860:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387841.045904:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7ee8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.045918:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.045928:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787387841.046290:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000211d9765 reply state 00000000bf849113 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387841.046301:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387841.046404:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:10527:x1874211690833024:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 672us (885us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787387841.046413:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:0.0:1787387841.049400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:1.0:1787387841.049535:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.049549:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7ee8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.049557:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.049564:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387841.049569:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.049577:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7ee8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.049595:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2d600) 00010000:00010000:1.0:1787387841.049598:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387841.049616:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7ee8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.049623:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7ee8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387841.049940:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690833152 00000100:00100000:3.0:1787387841.051677:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690833152 00000100:00100000:3.0:1787387841.051774:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:3.0:1787387841.051785:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690833152:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787387841.052050:0:11067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787387841.052054:0:11067:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787387841 -> 1787387840 00002000:00010000:3.0:1787387841.052065:0:11067:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787387839 00002000:00010000:3.0:1787387841.052067:0:11067:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787387841 -> 1787387840 00002000:00010000:3.0:1787387841.052069:0:11067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787387841.052145:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690833152:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 362us (2754us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787387841.052153:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:1.0:1787387841.057541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387841.057679:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690833408 00000100:00100000:0.0:1787387841.057689:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690833408 00000100:00100000:0.0:1787387841.057785:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:0.0:1787387841.057795:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:10527:x1874211690833408:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787387841.057881:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.057898:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7ea9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d7 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.057908:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.057942:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d7 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.057968:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d7 expref: 15 pid: 5809 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387841.057983:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709719808:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387841.058077:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4180 going to sleep for 11 seconds 00000100:00100000:3.0:1787387841.061087:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709719808:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387841.061116:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387841.061187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387841.061618:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690833536 00000100:00100000:1.0:1787387841.061625:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690833536 00010000:00010000:1.0:1787387841.061661:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d7 expref: 16 pid: 5809 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387841.061768:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:1.0:1787387841.061779:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:2351:x1874211690833536:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787387841.061796:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387841.061802:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d7 expref: 16 pid: 5809 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.061814:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d7 expref: 16 pid: 5809 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.061835:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c7ea9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529d7 expref: 16 pid: 5809 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.061851:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2d600) 00010000:00010000:1.0:1787387841.061856:0:8324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.061865:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.061887:0:8324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.061965:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387841.062024:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:2351:x1874211690833536:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 246us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387841.062032:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00010000:00010000:3.0:1787387841.063375:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.063390:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.063424:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.063525:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.063531:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.063554:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387841.063558:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.063567:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.063579:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2d600) 00010000:00010000:3.0:1787387841.063582:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787387841.063590:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.063596:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7eef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387841.063673:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:10527:x1874211690833408:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 5877us (6140us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787387841.063683:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:0.0:1787387841.066103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387841.066178:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690833664 00000100:00100000:3.0:1787387841.066188:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690833664 00000100:00100000:3.0:1787387841.066248:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:3.0:1787387841.066257:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2351:x1874211690833664:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787387841.066300:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.066318:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 7 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.066341:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387841.066345:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787387841.066349:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.066382:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 7 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.066394:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 7 pid: 11067 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387841.066408:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6604:1874211709719936:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387841.066632:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4349e340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387841.069712:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6604:1874211709719936:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387841.069774:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387841.072152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387841.072556:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690833792 00000100:00100000:2.0:1787387841.072567:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690833792 00010000:00010000:2.0:1787387841.072623:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 8 pid: 11067 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387841.072660:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:2.0:1787387841.072670:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2351:x1874211690833792:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387841.072684:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387841.072706:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 8 pid: 11067 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.072720:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 8 pid: 11067 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.072766:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025efa7da/0x93d41aeaa23c7ed3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529f3 expref: 8 pid: 11067 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.072783:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387841.072788:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387841.072794:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.072806:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.075344:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387841.075443:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2351:x1874211690833792:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 2756us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387841.075455:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00010000:00010000:1.0:1787387841.075815:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.075829:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.076625:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.076639:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.076649:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.076656:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387841.076661:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.076688:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.076706:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.076714:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083e23902/0x93d41aeaa23c7ef6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387841.076920:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690833664:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 10661us (10824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387841.076929:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:0.0:1787387841.079174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387841.079258:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690834048 00000100:00100000:2.0:1787387841.079268:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690834048 00000100:00100000:2.0:1787387841.079323:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:2.0:1787387841.079334:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:10527:x1874211690834048:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787387841.079424:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7efd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.079441:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.079452:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.080150:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.080162:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7eb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529de expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.080170:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.080208:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529de expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.080226:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7eb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529de expref: 15 pid: 5809 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387841.080242:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709720064:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387841.080376:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787387841.084426:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709720064:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387841.084458:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387841.085612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387841.085994:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690834176 00000100:00100000:2.0:1787387841.086003:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690834176 00010000:00010000:2.0:1787387841.086042:0:11042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7eb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529de expref: 16 pid: 5809 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387841.086089:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:2.0:1787387841.086099:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:2350:x1874211690834176:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387841.086112:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387841.086119:0:11042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7eb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529de expref: 16 pid: 5809 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.086131:0:11042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529de expref: 16 pid: 5809 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.086154:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c7eb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529de expref: 16 pid: 5809 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.086170:0:11042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2d600) 00010000:00010000:2.0:1787387841.086175:0:11042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.086185:0:11042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.086192:0:11042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.086227:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387841.086300:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:2350:x1874211690834176:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 202us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387841.086309:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00010000:00010000:3.0:1787387841.086419:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.086427:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787387841.086636:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787387841.087117:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787387841.087170:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787387841.087254:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5808:1874211709720192:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787387841.087306:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387841.087343:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43438de9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387841.088359:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709720192 00000100:00100000:3.0:1787387841.088369:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709720192 00000100:00100000:3.0:1787387841.088432:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787387841.088442:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5808:x1874211709720192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787387841.088546:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5808:x1874211709720192:12345-0@lo:1000:mdt00_001.0 Request processed in 105us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387841.088553:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787387841.088721:0:5808:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787387841.088728:0:5808:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:2.0:1787387841.088783:0:5808:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d437f6ce680, transno 4294967309 00000004:00080000:2.0:1787387841.088790:0:5808:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d437f6ce300, transno 4294967310 00000100:00100000:2.0:1787387841.088796:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5808:1874211709720192:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787387841.089301:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787387841.089380:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5808:1874211709720320:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787387841.089423:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387841.089445:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787387841.089891:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709720320 00000100:00100000:3.0:1787387841.089897:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709720320 00000100:00100000:3.0:1787387841.089925:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387841.089933:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5808:x1874211709720320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787387841.090180:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5808:x1874211709720320:12345-0@lo:1000:mdt00_001.0 Request processed in 247us (755us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787387841.090189:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787387841.090680:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5808:1874211709720320:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787387841.090716:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090727:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090735:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090772:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387841.090777:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090792:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090808:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c2d600) 00010000:00010000:2.0:1787387841.090811:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387841.090815:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090822:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7f04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090853:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090860:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090866:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090870:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387841.090873:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090878:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090885:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:2.0:1787387841.090887:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387841.090893:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7e4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529c2 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090918:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7e4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529c2 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.090927:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7e4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529c2 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.091071:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7e4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529c2 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387841.091087:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709720448:192.168.204.59@tcp:105: 00000100:00100000:2.0:1787387841.091206:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387841.100967:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709720448:192.168.204.59@tcp:105: 00010000:00010000:1.0:1787387841.101002:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101014:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7e47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101051:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7f0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101076:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7f0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101087:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7f0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101116:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7f0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101122:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7f0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101129:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7f0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101135:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387841.101138:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7f0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101146:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7f0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101157:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:1.0:1787387841.101159:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387841.101163:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7f0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101168:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7f0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101177:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101183:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7efd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101189:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7efd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101197:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387841.101201:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7efd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101206:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7efd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101213:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:1.0:1787387841.101215:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787387841.101217:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7efd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387841.101223:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7efd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387841.101480:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10527:x1874211690834048:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 22147us (22313us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787387841.101490:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 127 00000020:00080000:1.0:1787387841.101496:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787387841.107439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387841.107574:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690834304 00000100:00100000:3.0:1787387841.107583:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690834304 00000100:00100000:3.0:1787387841.107637:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1787387841.107648:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10526:x1874211690834304:12345-192.168.204.59@tcp:49:lfs.0 00000100:00100000:3.0:1787387841.107827:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10526:x1874211690834304:12345-192.168.204.59@tcp:49:lfs.0 Request processed in 180us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387841.107835:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000040:00080000:2.0:1787387841.109103:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387841.109113:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787387841.109541:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787387841.109551:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787387841.115868:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387841.115925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387841.116126:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690834560 00000100:00100000:2.0:1787387841.116136:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690834560 00000100:00100000:2.0:1787387841.116212:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:2.0:1787387841.116223:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10526:x1874211690834560:12345-192.168.204.59@tcp:58:lfs.0 00000040:00080000:2.0:1787387841.116622:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787387841.116721:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10526:x1874211690834560:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 499us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387841.116730:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:0.0:1787387841.117804:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690834816 00000100:00100000:0.0:1787387841.117814:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690834816 00000100:00100000:0.0:1787387841.117876:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:0.0:1787387841.117886:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d436567b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:10527:x1874211690834816:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787387841.119596:0:5811:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787387841.119721:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787387841.119805:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.119822:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.119836:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.119843:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.119861:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.119868:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.119895:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787387841.120014:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d436567b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:10527:x1874211690834816:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 2125us (4085us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787387841.120024:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000020:00080000:0.0:1787387841.120029:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787387841.120896:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387841.120913:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.120923:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71a00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387841.120927:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.120935:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.120950:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:3.0:1787387841.120964:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787387841.120968:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f12 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.120974:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.120992:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387841.120994:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387841.120996:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387841.186294:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387841.186824:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690834944 00000100:00100000:0.0:1787387841.186835:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690834944 00000100:00100000:0.0:1787387841.186899:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:0.0:1787387841.186908:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:10530:x1874211690834944:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387841.186933:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387841.186963:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7f19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b529fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.187049:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.187073:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.187085:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.187099:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7f27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.187106:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.187112:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.188328:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.188347:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529bb expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.188356:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.188392:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529bb expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387841.188424:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529bb expref: 21 pid: 5807 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387841.188439:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709720576:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387841.188850:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387841.194704:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709720576:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387841.194733:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787387841.197864:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1787387841.197880:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1787387841.197886:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1787387841.197899:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:1.0:1787387841.199207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387841.199328:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690835200 00000100:00100000:3.0:1787387841.199353:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690835200 00000100:00100000:3.0:1787387841.199410:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:3.0:1787387841.199420:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:5567:x1874211690835200:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787387841.199669:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:5567:x1874211690835200:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 250us (470us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787387841.199677:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:3.0:1787387841.201644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387841.203729:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690835328 00000100:00100000:1.0:1787387841.203865:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690835328 00010000:00010000:2.0:1787387841.204062:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529bb expref: 23 pid: 5807 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387841.204128:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:2.0:1787387841.204138:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:2350:x1874211690835328:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387841.204156:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387841.204163:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529bb expref: 23 pid: 5807 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.204289:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529bb expref: 23 pid: 5807 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.204312:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c7e39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529bb expref: 23 pid: 5807 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.204330:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:2.0:1787387841.204335:0:8324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.204344:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.204351:0:8324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387841.204414:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387841.204482:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:2350:x1874211690835328:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 344us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387841.204490:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00010000:00010000:3.0:1787387841.205903:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.205919:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387841.206024:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787387841.206029:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387841.206061:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206076:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206087:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206092:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206099:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206104:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387841.206122:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206130:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206142:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:3.0:1787387841.206144:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387841.206148:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206153:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206297:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206305:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7f27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206311:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7f27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206315:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387841.206318:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7f27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206324:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7f27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206332:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d4343c46100) 00010000:00010000:3.0:1787387841.206334:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387841.206343:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7f27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206348:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c7f27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206387:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c7f19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529fa expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206399:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529fa expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387841.206405:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:3.0:1787387841.206407:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387841.206409:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71800, rc 0) 00000100:00100000:3.0:1787387841.206589:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:10530:x1874211690834944:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 19681us (20303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387841.206598:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 129 00010000:00010000:2.0:1787387841.887034:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787387842.046845:0:11929:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787387842.046855:0:11929:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787387842.046924:0:11929:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787387842.046930:0:11929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787387842.142153:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787387842.142165:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787387842.142224:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787387842.142231:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787387842.142385:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709720704:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787387842.142533:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387842.147894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387842.147942:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690835456 00000100:00100000:3.0:1787387842.147952:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690835456 00000100:00100000:3.0:1787387842.148016:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:3.0:1787387842.148027:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:10542:x1874211690835456:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787387842.148074:0:5809:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787387842.148178:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:10542:x1874211690835456:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 153us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387842.148186:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00080000:3.0:1787387842.148209:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387842.149653:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709720704:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787387842.160249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387842.160335:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690835712 00000100:00100000:1.0:1787387842.160350:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690835712 00000100:00100000:1.0:1787387842.160416:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:1.0:1787387842.160429:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:10542:x1874211690835712:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787387842.160465:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387842.160498:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7f35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a01 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387842.160626:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7f3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387842.160642:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7f3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387842.160655:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7f3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387842.160668:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787387842.161132:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c7f35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a01 expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387842.161150:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7f3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a01 expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387842.161160:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:1.0:1787387842.161164:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787387842.161168:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4c00, rc 0) 00000100:00100000:1.0:1787387842.161244:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:10542:x1874211690835712:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 817us (1003us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787387842.161253:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:2.0:1787387842.171641:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387842.171713:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690835968 00000100:00100000:3.0:1787387842.171725:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690835968 00000100:00100000:3.0:1787387842.172316:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:3.0:1787387842.172330:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:10542:x1874211690835968:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787387842.172416:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387842.172436:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387842.172463:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387842.172684:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387842.172692:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387842.172699:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387842.172705:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387842.172709:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387842.172718:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387842.172734:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:3.0:1787387842.172757:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787387842.172763:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387842.172779:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387842.172928:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:10542:x1874211690835968:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 601us (1296us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787387842.172936:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 132 00000040:00080000:2.0:1787387842.173187:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387842.173193:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787387842.173608:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787387842.173617:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787387842.179399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387842.182364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387842.182904:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690836352 00000100:00100000:3.0:1787387842.182918:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690836352 00000100:00100000:3.0:1787387842.183006:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1787387842.183017:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:2350:x1874211690836352:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387842.183045:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387842.183072:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7f3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a01 expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387842.183093:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:3.0:1787387842.183098:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387842.183165:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:2350:x1874211690836352:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 149us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387842.183173:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1787387842.188898:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690836224 00000100:00100000:1.0:1787387842.188922:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690836224 00000100:00100000:1.0:1787387842.189018:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:1.0:1787387842.189031:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:10542:x1874211690836224:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787387842.189307:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:10542:x1874211690836224:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 278us (9918us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787387842.189315:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00010000:00010000:1.0:1787387842.910073:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387843.167243:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709720960:0@lo:400:kworker.0 00000100:00100000:1.0:1787387843.167324:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387843.167475:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f7db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709720832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387843.167511:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387843.167553:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709720832 00000100:00100000:3.0:1787387843.167560:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709720832 00000100:00100000:3.0:1787387843.167615:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787387843.167624:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709720832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787387843.167676:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387843.167757:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709720832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387843.167765:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1787387843.167788:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387843.167815:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787387843.167821:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1787387843.167839:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d437a2d9f80, transno 4294967301 00000004:00080000:3.0:1787387843.167850:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787387843.167864:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d437f6cc000, transno 4294967304 00000100:00100000:3.0:1787387843.167876:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f7db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709720832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387843.173551:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709721088:0@lo:400:kworker.0 00000100:00100000:2.0:1787387843.173625:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387843.173675:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387843.173681:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709721216:0@lo:400:kworker.0 00000100:00100000:2.0:1787387843.173704:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387843.173753:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709721088 00000100:00100000:2.0:1787387843.173760:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709721088 00000100:00100000:2.0:1787387843.173805:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709721216 00000100:00100000:2.0:1787387843.173808:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709721216 00000100:00100000:2.0:1787387843.173832:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787387843.173841:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709721088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387843.173892:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709721088:12345-0@lo:400:kworker.0 Request processed in 51us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387843.173900:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787387843.173918:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787387843.173924:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709721216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387843.173950:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709721216:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387843.173956:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787387843.173997:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709721216:0@lo:400:kworker.0 00000100:00100000:2.0:1787387843.174009:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709721088:0@lo:400:kworker.0 00000100:00100000:0.0:1787387843.174047:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709720960 00000100:00100000:0.0:1787387843.174051:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709720960 00000100:00100000:0.0:1787387843.174080:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787387843.174087:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709720960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387843.174134:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709720960:12345-0@lo:400:kworker.0 Request processed in 48us (6810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387843.174140:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:3.0:1787387843.176204:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387843.176231:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709721344:0@lo:400:kworker.0 00000100:00100000:1.0:1787387843.176231:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709721472:0@lo:400:kworker.0 00000100:00100000:3.0:1787387843.176297:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387843.176336:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387843.176368:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709720960:0@lo:400:kworker.0 00000100:00100000:2.0:1787387843.176433:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709721344 00000100:00100000:2.0:1787387843.176439:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709721344 00000100:00100000:2.0:1787387843.176496:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787387843.176506:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874211709721344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387843.176556:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874211709721344:12345-0@lo:400:kworker.0 Request processed in 51us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387843.176563:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787387843.176586:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709721472 00000100:00100000:2.0:1787387843.176589:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709721472 00000100:00100000:2.0:1787387843.176615:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787387843.176621:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709721472:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787387843.176765:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387843.176769:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387843.176789:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709721344:0@lo:400:kworker.0 00000100:00100000:2.0:1787387843.176863:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709721472:12345-0@lo:400:kworker.0 Request processed in 35us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387843.176872:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787387843.177091:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709721472:0@lo:400:kworker.0 00010000:00010000:3.0:1787387843.934706:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787387844.100790:0:11980:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387844.100800:0:11980:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787387844.100841:0:11980:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787387844.100847:0:11980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787387844.199100:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387844.199138:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709721600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387844.199213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387844.199274:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709721600 00000100:00100000:1.0:1787387844.199281:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709721600 00000100:00100000:1.0:1787387844.199326:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787387844.199335:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709721600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787387844.199373:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387844.199421:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709721600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387844.199428:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787387844.199645:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709721600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387844.368376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387844.368466:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690836608 00000100:00100000:0.0:1787387844.368477:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690836608 00000100:00100000:0.0:1787387844.368558:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:0.0:1787387844.368570:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:10562:x1874211690836608:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387844.368598:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387844.368620:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7f51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a08 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387844.368767:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7f58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387844.368781:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7f58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387844.368793:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7f58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387844.368805:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787387844.368931:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7f51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a08 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387844.368948:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7f58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a08 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387844.368957:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387844.368959:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787387844.368963:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70400, rc 0) 00000100:00100000:0.0:1787387844.369031:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:10562:x1874211690836608:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 464us (667us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787387844.369056:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00080000:3.0:1787387844.369271:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387844.377719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387844.377840:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690836736 00000100:00100000:3.0:1787387844.377860:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690836736 00000100:00100000:3.0:1787387844.377980:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:3.0:1787387844.378006:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:10562:x1874211690836736:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:3.0:1787387844.378292:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387844.378395:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387844.378434:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387844.378474:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387844.378483:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387844.378490:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387844.378496:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387844.378501:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387844.378510:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387844.378526:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:3.0:1787387844.378530:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787387844.378536:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387844.378543:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c7f66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387844.380420:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:10562:x1874211690836736:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 2413us (2696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387844.380440:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:3.0:1787387844.493141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387844.493316:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690836864 00000100:00100000:1.0:1787387844.493332:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690836864 00000100:00100000:1.0:1787387844.493421:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:1.0:1787387844.493449:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2353:x1874211690836864:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:1.0:1787387844.493471:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387844.493496:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7f6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a0f expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787387844.493526:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a895fc0, atime: 0x6a895fbf, ctime: 0x6a895fc0, blocks: 0xb 00010000:00010000:1.0:1787387844.493545:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1787387844.493551:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387844.493561:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7f6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a0f expref: 7 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387844.493583:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7f6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a0f expref: 7 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387844.493598:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5e00, rc 0) 00000100:00100000:1.0:1787387844.493659:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2353:x1874211690836864:12345-192.168.204.59@tcp:101:cat.0 Request processed in 213us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387844.493667:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00080000:3.0:1787387844.494802:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387844.498159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387844.498264:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690836992 00000100:00100000:3.0:1787387844.498276:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690836992 00002000:00100000:3.0:1787387844.498329:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d43747cb800 x1874211690836992/t0(0) o3->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:100/0 lens 488/0 e 0 to 0 dl 1787387855 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787387844.498340:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d43747cb800 with x1874211690836992 ext(0->4095) 00002000:00010000:3.0:1787387844.498346:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d43747cb800 00000100:00100000:3.0:1787387844.498380:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:3.0:1787387844.498390:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2353:x1874211690836992:12345-192.168.204.59@tcp:3:cat.0 00000100:00100000:3.0:1787387844.498644:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2353:x1874211690836992:12345-192.168.204.59@tcp:3:cat.0 Request processed in 254us (497us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787387844.498652:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00002000:00100000:3.0:1787387844.498658:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d43747cb800 x1874211690836992/t0(0) o3->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:100/0 lens 488/4536 e 0 to 0 dl 1787387855 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787387844.498665:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d43747cb800 with x1874211690836992 ext(0->4095) 00002000:00010000:3.0:1787387844.498668:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d43747cb800 00010000:00010000:2.0:1787387844.967317:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387845.044266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387845.044316:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387845.044437:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690837120 00000100:00100000:1.0:1787387845.044448:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690837120 00000100:00100000:2.0:1787387845.044465:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690837248 00000100:00100000:2.0:1787387845.044472:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690837248 00000100:00100000:1.0:1787387845.044509:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 295 00000100:00100000:1.0:1787387845.044521:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2353:x1874211690837120:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387845.044537:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:2.0:1787387845.044547:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:2353:x1874211690837248:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387845.044601:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:2353:x1874211690837248:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 56us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387845.044609:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:1.0:1787387845.049146:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2353:x1874211690837120:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 4614us (4876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387845.049192:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 295 00000100:00100000:0.0:1787387845.060030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387845.060122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387845.060239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387845.060281:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690837632 00000100:00100000:0.0:1787387845.060290:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690837632 00000100:00100000:0.0:1787387845.060350:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 154 00000100:00100000:0.0:1787387845.060360:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690837632:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387845.060623:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690837504 00000100:00100000:2.0:1787387845.060643:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690837504 00000100:00100000:2.0:1787387845.060675:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690837376 00000100:00100000:2.0:1787387845.060678:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690837376 00000100:00100000:2.0:1787387845.060700:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:2.0:1787387845.060717:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690837504:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387845.060781:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2352:x1874211690837504:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 65us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387845.060789:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:2.0:1787387845.060807:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:2.0:1787387845.060814:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2352:x1874211690837376:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387845.060842:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2352:x1874211690837376:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387845.060849:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00080000:2.0:1787387845.060887:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787387845.060892:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387845.060973:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690837632:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 613us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387845.060991:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 154 00010000:00010000:2.0:1787387845.983179:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787387846.358548:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1787387846.358582:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787387846.358619:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:1.0:1787387846.358645:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:3.0:1787387846.358690:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d4374241480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787387846.358695:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d4350cea700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d4374241900 00000020:00080000:3.0:1787387846.358698:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d4350cea600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d4372008000 00000020:00080000:1.0:1787387846.359003:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787387846.359206:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1787387846.362588:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787387846.362603:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:3.0:1787387847.006125:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387848.030667:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387848.287071:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387848.287096:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709721728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387848.287166:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387848.287241:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709721728 00000100:00100000:1.0:1787387848.287250:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709721728 00000100:00100000:1.0:1787387848.287531:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787387848.287541:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709721728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387848.287577:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387848.287625:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709721728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387848.287632:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787387848.287652:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787387848.287684:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709721728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387848.296645:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387848.296716:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387848.296755:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709721984:0@lo:400:kworker.0 00000100:00100000:0.0:1787387848.296840:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387848.296903:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709721984 00000100:00100000:0.0:1787387848.296911:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709721984 00000100:00100000:0.0:1787387848.296972:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787387848.296981:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709721984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387848.297033:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709721984:12345-0@lo:400:kworker.0 Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387848.297040:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787387848.297083:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709721984:0@lo:400:kworker.0 00000100:00100000:1.0:1787387848.305863:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709721856:0@lo:400:kworker.0 00000100:00100000:1.0:1787387848.305963:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387848.306135:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709721856 00000100:00100000:2.0:1787387848.306144:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709721856 00000100:00100000:2.0:1787387848.306212:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787387848.306222:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709721856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387848.306283:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709721856:12345-0@lo:400:kworker.0 Request processed in 62us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387848.306303:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787387848.307487:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709722240:0@lo:400:kworker.0 00000100:00100000:3.0:1787387848.307538:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387848.307570:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387848.307588:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709722112:0@lo:400:kworker.0 00000100:00100000:3.0:1787387848.307616:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387848.307648:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709722240 00000100:00100000:3.0:1787387848.307653:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709722240 00000100:00100000:3.0:1787387848.307699:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787387848.307707:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709722240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387848.307776:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709722240:12345-0@lo:400:kworker.0 Request processed in 70us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387848.307782:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787387848.307804:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709722112 00000100:00100000:3.0:1787387848.307808:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709722112 00000100:00100000:3.0:1787387848.307850:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787387848.307856:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709722112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387848.307886:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874211709722112:12345-0@lo:400:kworker.0 Request processed in 29us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387848.307891:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787387848.307940:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874211709722112:0@lo:400:kworker.0 00000100:00100000:3.0:1787387848.307949:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787387848.307954:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787387848.307970:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709722240:0@lo:400:kworker.0 00000100:00100000:2.0:1787387848.308235:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709722368:0@lo:400:kworker.0 00000100:00100000:2.0:1787387848.308267:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787387848.308558:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787387848.308564:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387848.308594:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709721856:0@lo:400:kworker.0 00000100:00100000:3.0:1787387848.312180:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709722368 00000100:00100000:3.0:1787387848.312500:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709722368 00000100:00100000:3.0:1787387848.312644:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787387848.312655:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709722368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387848.312775:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709722368:12345-0@lo:400:kworker.0 Request processed in 121us (4505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387848.312798:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787387848.313001:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709722368:0@lo:400:kworker.0 00000100:00080000:1.0:1787387848.321402:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787387848.350728:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787387848.350802:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787387848.350866:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787387848.350873:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787387849.056089:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387849.311108:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387849.311134:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709722496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387849.311201:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387849.311344:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709722496 00000100:00100000:1.0:1787387849.311353:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709722496 00000100:00100000:1.0:1787387849.311407:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787387849.311417:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709722496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787387849.311453:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387849.311508:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709722496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387849.311515:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787387849.311594:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709722496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787387850.079963:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387850.169259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387850.169304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387850.169340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387850.169373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387850.169400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387850.169639:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690838272 00000100:00100000:0.0:1787387850.169649:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690838272 00000100:00100000:0.0:1787387850.169711:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690837888 00000100:00100000:0.0:1787387850.169715:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690837888 00000100:00100000:0.0:1787387850.169756:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 158 00000100:00100000:0.0:1787387850.169766:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690838272:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387850.169864:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2352:x1874211690838272:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 100us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387850.169872:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 158 00000100:00100000:0.0:1787387850.169900:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 159 00000100:00100000:0.0:1787387850.169906:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:2353:x1874211690837888:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387850.169933:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:2353:x1874211690837888:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387850.169939:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 159 00000100:00100000:1.0:1787387850.170067:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690837760 00000100:00100000:1.0:1787387850.170072:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690837760 00000100:00100000:1.0:1787387850.170103:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 297 00000100:00100000:1.0:1787387850.170110:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690837760:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387850.170137:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2352:x1874211690837760:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387850.170144:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 297 00000100:00100000:1.0:1787387850.170174:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690838016 00000100:00100000:1.0:1787387850.170178:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690838016 00000100:00100000:1.0:1787387850.170206:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690838144 00000100:00100000:1.0:1787387850.170209:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690838144 00000100:00100000:1.0:1787387850.170232:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:1.0:1787387850.170238:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2352:x1874211690838016:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387850.170264:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2352:x1874211690838016:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387850.170271:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:1.0:1787387850.170281:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:1.0:1787387850.170303:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690838144:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387850.170341:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690838144:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 38us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387850.170348:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00080000:1.0:1787387850.170365:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387850.170369:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387850.170372:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387850.255595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387850.255726:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690838400 00000100:00100000:0.0:1787387850.255773:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690838400 00000100:00100000:0.0:1787387850.255859:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:0.0:1787387850.256139:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:10215:x1874211690838400:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787387850.256290:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:10215:x1874211690838400:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 Request processed in 158us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387850.256299:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:1.0:1787387850.259544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387850.259788:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690838656 00000100:00100000:3.0:1787387850.259811:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690838656 00000100:00100000:3.0:1787387850.260019:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:3.0:1787387850.260033:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:10215:x1874211690838656:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787387850.260668:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:10215:x1874211690838656:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 634us (1136us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787387850.260678:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:2.0:1787387850.728663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387850.729102:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690838784 00000100:00100000:3.0:1787387850.729118:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690838784 00000100:00100000:3.0:1787387850.729392:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 136 00000100:00100000:3.0:1787387850.729406:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:11016:x1874211690838784:12345-192.168.204.59@tcp:101:lsof.0 00010000:00010000:3.0:1787387850.729436:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387850.729465:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7f74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a16 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387850.729559:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387850.729577:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387850.729612:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387850.731482:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787387850.731496:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387850.731715:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387850.731791:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7f74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a16 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387850.731815:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a16 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387850.731827:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:3.0:1787387850.731830:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387850.731835:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460bc00, rc 0) 00000100:00100000:3.0:1787387850.733203:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:11016:x1874211690838784:12345-192.168.204.59@tcp:101:lsof.0 Request processed in 3786us (4542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387850.733217:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 136 00010000:00010000:2.0:1787387851.104778:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787387851.439035:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1787387851.439065:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787387851.439114:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787387851.439126:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787387852.127874:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387853.150220:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387853.406322:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709722752:0@lo:400:kworker.0 00000100:00100000:0.0:1787387853.406426:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387853.406490:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709723264:0@lo:400:kworker.0 00000100:00100000:0.0:1787387853.406519:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387853.406561:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787387853.406568:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709722624:0@lo:400:kworker.0 00000100:00100000:0.0:1787387853.406598:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387853.406634:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709723136:0@lo:400:kworker.0 00000100:00100000:0.0:1787387853.406656:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387853.406689:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709722752 00000100:00100000:0.0:1787387853.406697:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709722752 00000100:00100000:0.0:1787387853.406777:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709723136 00000100:00100000:0.0:1787387853.406781:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709723136 00000100:00100000:1.0:1787387853.406788:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709723264 00000100:00100000:1.0:1787387853.406794:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709723264 00000100:00100000:0.0:1787387853.406829:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787387853.406841:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709722752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387853.406847:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387853.406858:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709723264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387853.407396:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709722880:0@lo:400:kworker.0 00000100:00100000:1.0:1787387853.407460:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709723264:12345-0@lo:400:kworker.0 Request processed in 603us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387853.407469:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787387853.407489:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787387853.407502:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709723136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387853.407503:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709722624 00000100:00100000:1.0:1787387853.407509:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709722624 00000100:00100000:1.0:1787387853.407538:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787387853.407544:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709722624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387853.407578:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709722624:12345-0@lo:400:kworker.0 Request processed in 34us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387853.407587:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787387853.407588:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709722752:12345-0@lo:400:kworker.0 Request processed in 747us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387853.407598:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1787387853.407640:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387853.407646:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387853.407709:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709722624:0@lo:400:kworker.0 00000100:00100000:3.0:1787387853.407851:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709723136:12345-0@lo:400:kworker.0 Request processed in 353us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387853.407858:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787387853.407893:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709723008:0@lo:400:kworker.0 00000100:00100000:3.0:1787387853.407943:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387853.407968:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387853.407974:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709723392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387853.407998:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387853.408027:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709723008 00000100:00100000:3.0:1787387853.408030:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709723008 00000100:00100000:3.0:1787387853.408065:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787387853.408071:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709723008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387853.408107:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709723008:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387853.408126:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787387853.408147:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709722752:0@lo:400:kworker.0 00000100:00100000:3.0:1787387853.408148:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709723392 00000100:00100000:3.0:1787387853.408154:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709723392 00000100:00100000:1.0:1787387853.408169:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709723264:0@lo:400:kworker.0 00000100:00100000:3.0:1787387853.408190:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787387853.408199:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709723392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387853.408201:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709723136:0@lo:400:kworker.0 00002000:00000024:3.0:1787387853.408232:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787387853.408250:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387853.408265:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709723392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387853.408273:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787387853.408305:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709723392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387853.408316:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709723008:0@lo:400:kworker.0 00000100:00100000:2.0:1787387853.417997:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387853.418591:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709722880 00000100:00100000:1.0:1787387853.418602:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709722880 00000100:00100000:1.0:1787387853.418692:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787387853.418702:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709722880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387853.418811:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709722880:12345-0@lo:400:kworker.0 Request processed in 111us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387853.418829:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1787387853.420927:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387853.421070:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709722880:0@lo:400:kworker.0 00010000:00010000:2.0:1787387854.174102:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387854.430071:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387854.430096:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709723520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387854.430170:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387854.430299:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709723520 00000100:00100000:1.0:1787387854.430307:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709723520 00000100:00100000:1.0:1787387854.430360:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787387854.430369:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709723520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787387854.430405:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387854.430464:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709723520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387854.430472:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787387854.430573:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43747cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709723520:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787387855.042952:0:12185:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:37:33 (1787387853) 00010000:00010000:1.0:1787387855.198927:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387855.289437:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387855.289473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387855.289503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387855.289524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387855.289543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387855.289567:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690838912 00000100:00100000:0.0:1787387855.289577:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690838912 00000100:00100000:0.0:1787387855.289625:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 299 00000100:00100000:0.0:1787387855.289634:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2351:x1874211690838912:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387855.290483:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2351:x1874211690838912:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 845us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387855.290495:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 299 00000100:00100000:0.0:1787387855.290542:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690839168 00000100:00100000:0.0:1787387855.290547:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690839168 00000100:00100000:0.0:1787387855.290586:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690839296 00000100:00100000:0.0:1787387855.290590:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690839296 00000100:00100000:0.0:1787387855.290613:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:0.0:1787387855.290619:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690839168:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387855.290655:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690839168:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 36us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387855.290661:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:0.0:1787387855.290673:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:0.0:1787387855.290695:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690839296:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387855.290718:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690839296:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387855.290724:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:0.0:1787387855.290757:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690839424 00000100:00100000:0.0:1787387855.290761:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690839424 00000100:00100000:0.0:1787387855.290806:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690839040 00000100:00100000:0.0:1787387855.290810:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690839040 00000100:00100000:0.0:1787387855.290833:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:0.0:1787387855.290839:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:2351:x1874211690839424:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387855.290865:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:2351:x1874211690839424:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387855.290871:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:0.0:1787387855.290881:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00100000:0.0:1787387855.290886:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:2350:x1874211690839040:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387855.290911:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:2350:x1874211690839040:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387855.290917:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00080000:0.0:1787387855.291060:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787387855.291064:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787387855.291066:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787387856.222440:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387857.112216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387857.113158:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690839680 00000100:00100000:0.0:1787387857.113173:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690839680 00000100:00080000:2.0:1787387857.113320:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387857.115922:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 137 00000100:00100000:0.0:1787387857.115949:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:11282:x1874211690839680:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787387857.115976:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387857.116004:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a1d expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.116087:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f89 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.116103:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.116136:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.116154:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7f90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.116160:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7f90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.116168:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7f90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.116644:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7f97 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.116655:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7f97 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.116663:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7f97 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387857.116674:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787387857.121725:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127259:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f89 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127271:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127278:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387857.127301:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127310:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f89 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127329:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d436f2f6f00) 00010000:00010000:0.0:1787387857.127333:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387857.127337:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127344:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c7f89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127368:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7f90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127374:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7f90 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127380:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7f90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127385:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387857.127388:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7f90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127393:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7f90 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127400:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d4343c46500) 00010000:00010000:0.0:1787387857.127402:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387857.127412:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7f90 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127417:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c7f90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.127985:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c7f82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a1d expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.128003:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7f97 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a1d expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387857.128010:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:0.0:1787387857.128012:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387857.128015:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70a00, rc 0) 00000100:00100000:0.0:1787387857.128110:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:11282:x1874211690839680:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 12175us (15903us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787387857.128120:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 137 00000100:00100000:0.0:1787387857.137890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387857.137932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387857.138024:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690839936 00000100:00100000:1.0:1787387857.138034:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690839936 00000100:00100000:1.0:1787387857.138101:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 138 00000100:00100000:3.0:1787387857.138106:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690839808 00000100:00100000:3.0:1787387857.138111:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690839808 00000100:00100000:1.0:1787387857.138111:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:11282:x1874211690839936:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787387857.138161:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1787387857.138168:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:2353:x1874211690839808:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387857.138194:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387857.138220:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c7f97 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a1d expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387857.138229:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:11282:x1874211690839936:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 120us (351us total) trans 0 rc 0/0 00010000:00010000:3.0:1787387857.138240:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:3.0:1787387857.138245:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387857.138250:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 138 00000100:00100000:3.0:1787387857.138263:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:2353:x1874211690839808:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 97us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387857.138270:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00010000:00010000:2.0:1787387857.246174:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787387857.568371:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787387857.568381:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787387857.569000:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787387857.569009:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787387858.270199:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387858.526607:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709723776:0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.526695:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387858.526837:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709724288:0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.526864:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387858.526893:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787387858.526900:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709723648:0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.526928:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387858.526951:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709724160:0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.526972:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387858.526997:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709724032:0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.527020:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387858.527035:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387858.527040:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709723904:0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.527061:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387858.527090:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709723776 00000100:00100000:3.0:1787387858.527096:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709723776 00000100:00100000:3.0:1787387858.527150:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709724160 00000100:00100000:3.0:1787387858.527154:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709724160 00000100:00100000:3.0:1787387858.527178:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709723904 00000100:00100000:3.0:1787387858.527181:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709723904 00000100:00100000:3.0:1787387858.527198:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787387858.527206:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709723776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.527266:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709723776:12345-0@lo:400:kworker.0 Request processed in 60us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387858.527274:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787387858.527292:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787387858.527298:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709724160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.527329:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709724160:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387858.527335:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787387858.527346:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787387858.527352:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709723904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.527382:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709723904:12345-0@lo:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387858.527389:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787387858.527407:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709723648 00000100:00100000:3.0:1787387858.527411:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709723648 00000100:00100000:3.0:1787387858.527433:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787387858.527439:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709723648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.527467:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709723648:12345-0@lo:400:kworker.0 Request processed in 28us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387858.527473:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:3.0:1787387858.527500:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387858.527536:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709723904:0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.527564:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709723648:0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.527573:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709724160:0@lo:400:kworker.0 00000100:00100000:3.0:1787387858.527581:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709723776:0@lo:400:kworker.0 00000100:00100000:0.0:1787387858.528242:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709724416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387858.528289:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387858.528347:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709724288 00000100:00100000:0.0:1787387858.528352:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709724288 00000100:00100000:0.0:1787387858.528392:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709724032 00000100:00100000:0.0:1787387858.528404:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709724032 00000100:00100000:0.0:1787387858.528431:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787387858.528438:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709724288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387858.528481:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709724288:12345-0@lo:400:kworker.0 Request processed in 43us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387858.528487:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787387858.528501:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787387858.528507:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709724032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387858.528530:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709724032:12345-0@lo:400:kworker.0 Request processed in 24us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387858.528536:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787387858.528566:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787387858.528570:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387858.528589:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709724288:0@lo:400:kworker.0 00000100:00100000:1.0:1787387858.528653:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709724416 00000100:00100000:1.0:1787387858.528658:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709724416 00000100:00100000:1.0:1787387858.528695:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387858.528703:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434645bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709724416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387858.528756:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387858.528791:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434645bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709724416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387858.528798:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787387858.528920:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709724416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387858.529357:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709724032:0@lo:400:kworker.0 00000040:00080000:0.0:1787387858.591088:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787387858.591099:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787387858.591565:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787387858.591573:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787387859.224204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387859.224410:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690840064 00000100:00100000:3.0:1787387859.224419:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690840064 00000100:00100000:3.0:1787387859.224489:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00100000:3.0:1787387859.224499:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:11324:x1874211690840064:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387859.224520:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387859.224542:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c7fa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a24 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.224618:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7fac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.224632:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7fac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.224645:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7fac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.224660:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c7fb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.224667:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c7fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.224685:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c7fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225036:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7fac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225043:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7fac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225050:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7fac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225055:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387859.225059:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7fac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225066:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7fac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225079:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:3.0:1787387859.225082:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387859.225101:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7fac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225108:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c7fac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225118:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c7fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225124:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c7fb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225135:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c7fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225141:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ae00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387859.225144:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c7fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225150:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c7fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225159:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d4343c2d000) 00010000:00010000:3.0:1787387859.225161:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387859.225178:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c7fb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225183:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c7fb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225216:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c7fa5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a24 expref: 15 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225225:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:3.0:1787387859.225227:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387859.225231:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c7fa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a24 expref: 15 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.225240:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460b400, rc 0) 00000100:00100000:3.0:1787387859.225318:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:11324:x1874211690840064:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 820us (1119us total) trans 0 rc 301/301 00000100:00100000:3.0:1787387859.225337:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00080000:0.0:1787387859.226097:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387859.239386:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.239564:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690840320 00000100:00100000:0.0:1787387859.239574:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690840320 00000100:00100000:0.0:1787387859.239637:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:0.0:1787387859.239660:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:11324:x1874211690840320:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:0.0:1787387859.239725:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387859.239779:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c7923 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5285d expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.239797:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:0.0:1787387859.239802:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387859.240193:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.240209:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a16 expref: 5 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.240218:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.240247:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a16 expref: 5 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.240261:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a16 expref: 5 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387859.240275:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709724544:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387859.240372:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342e72600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387859.244109:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709724544:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387859.244137:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387859.245320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.245562:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690840448 00000100:00100000:0.0:1787387859.245571:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690840448 00010000:00010000:0.0:1787387859.245622:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a16 expref: 6 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387859.245679:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:0.0:1787387859.245688:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:2351:x1874211690840448:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387859.245713:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387859.245720:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a16 expref: 6 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.245733:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a16 expref: 6 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.245774:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460bc00/0x93d41aeaa23c7f7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a16 expref: 6 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.245791:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:0.0:1787387859.245797:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.245807:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.245819:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.245842:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1787387859.245944:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387859.246049:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2351:x1874211690840448:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 360us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387859.246057:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00010000:00010000:0.0:1787387859.246085:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.246097:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.246119:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7fc1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.246129:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.246136:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387859.250142:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787387859.250161:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.250172:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.250179:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.250186:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387859.250190:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.250197:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.250215:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4343c2d900) 00010000:00010000:0.0:1787387859.250218:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387859.250233:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.250240:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c7fba lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787387859.250264:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073351135 reply state 00000000667ea3c6 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387859.250274:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387859.251240:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:11324:x1874211690840320:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 11588us (11856us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787387859.251251:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 140 00010000:00010000:2.0:1787387859.263207:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.263228:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7fc1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.263236:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.263243:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387859.263248:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.263270:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7fc1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.263288:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d4343c46500) 00010000:00010000:2.0:1787387859.263291:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387859.263296:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7fc1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.263302:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c7fc1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.294066:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387859.392940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387859.393051:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690840576 00000100:00100000:2.0:1787387859.393062:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690840576 00000100:00100000:2.0:1787387859.393122:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:2.0:1787387859.393133:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:11333:x1874211690840576:12345-192.168.204.59@tcp:101:lctl.0 00010000:00010000:2.0:1787387859.393158:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387859.393184:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a2b expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.393253:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7fcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.393265:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.393277:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387859.393339:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787387859.393356:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787387859.393387:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.393412:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a2b expref: 16 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.393429:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7fcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a2b expref: 15 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.393437:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:2.0:1787387859.393440:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787387859.393444:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fd200, rc 0) 00000100:00100000:2.0:1787387859.393526:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:11333:x1874211690840576:12345-192.168.204.59@tcp:101:lctl.0 Request processed in 394us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387859.393535:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:3.0:1787387859.448026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387859.448164:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690840704 00000100:00100000:1.0:1787387859.448181:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690840704 00000100:00100000:1.0:1787387859.448242:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00100000:1.0:1787387859.448252:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+15:11339:x1874211690840704:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1787387859.448274:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387859.448298:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7fd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a32 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.448369:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7fdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.448385:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.448396:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.448427:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7fe4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.448435:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.448442:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.448560:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.448569:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.448577:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387859.448623:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787387859.448627:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787387859.450439:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450461:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450469:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7fdd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450476:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7fdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450500:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387859.450504:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7fdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450512:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7fdd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450527:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:1.0:1787387859.450530:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387859.450534:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7fdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450541:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c7fdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450557:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450562:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450568:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450573:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387859.450576:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450580:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450594:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d4358720000) 00010000:00010000:1.0:1787387859.450597:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387859.450599:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7fe4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450604:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c7fe4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450653:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c7fd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a32 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450665:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a32 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.450673:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:1.0:1787387859.450675:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787387859.450678:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4c00, rc 0) 00000100:00100000:1.0:1787387859.451329:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:11339:x1874211690840704:12345-192.168.204.59@tcp:101:bash.0 Request processed in 3074us (3308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387859.451338:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00100000:0.0:1787387859.460892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387859.460977:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690840960 00000100:00100000:2.0:1787387859.460988:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690840960 00000100:00100000:2.0:1787387859.461159:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 143 00000100:00100000:2.0:1787387859.461180:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:11339:x1874211690840960:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1787387859.461207:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387859.461230:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ff2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a39 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.461372:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ff9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.461388:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.461416:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.461484:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8000 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.461493:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.461501:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787387859.462984:0:6840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787387859.463487:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8007 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.463503:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.463516:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.463556:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.463564:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ff9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.463571:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.463578:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387859.463593:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.463601:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ff9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.463614:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:2.0:1787387859.463617:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387859.463621:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ff9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.463628:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c7ff9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787387859.463648:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000200e063d reply state 00000000a8ae22eb transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387859.463658:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787387859.463802:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c7ff2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a39 expref: 19 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.463821:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a39 expref: 18 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.463829:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d436f2f6d00) 00010000:00010000:2.0:1787387859.463831:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787387859.463834:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fc600, rc 0) 00000100:00100000:2.0:1787387859.464037:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:11339:x1874211690840960:12345-192.168.204.59@tcp:101:bash.0 Request processed in 2859us (3301us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787387859.464047:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 143 00000100:00100000:3.0:1787387859.467128:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.467725:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690841088 00000100:00100000:0.0:1787387859.467774:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690841088 00000100:00080000:3.0:1787387859.467830:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387859.467842:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:0.0:1787387859.467852:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2351:x1874211690841088:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1787387859.467871:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387859.467894:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aea45e0/0x93d41aeaa23c8015 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a40 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787387859.467924:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787387859.467943:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1787387859.467947:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387859.467956:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aea45e0/0x93d41aeaa23c8015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a40 expref: 6 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.467973:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009aea45e0/0x93d41aeaa23c8015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a40 expref: 6 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.468001:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70c00, rc 0) 00000100:00100000:0.0:1787387859.468066:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690841088:12345-192.168.204.59@tcp:101:bash.0 Request processed in 216us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387859.468074:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00010000:00010000:1.0:1787387859.468789:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.468800:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8000 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.468807:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8000 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.468825:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fda00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387859.468831:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8000 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.468838:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8000 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.468854:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d436f2f6800) 00010000:00010000:1.0:1787387859.468857:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387859.468862:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8000 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.468868:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8000 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387859.472027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.472507:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690841216 00000100:00100000:0.0:1787387859.472518:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690841216 00000100:00100000:0.0:1787387859.472615:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:0.0:1787387859.472895:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:11339:x1874211690841216:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1787387859.472913:0:6604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387859.472932:0:6604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a47 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.472962:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009aea45e0/0x93d41aeaa23c8015 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a40 expref: 7 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.472970:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387859.472974:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387859.472979:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 7 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.473010:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009aea45e0/0x93d41aeaa23c8015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a40 expref: 7 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.473023:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009aea45e0/0x93d41aeaa23c8015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a40 expref: 7 pid: 6606 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387859.473049:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1874211709724672:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387859.473249:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342e72600 going to sleep for 11 seconds 00000100:00100000:3.0:1787387859.476560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387859.476645:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690841344 00000100:00100000:2.0:1787387859.476654:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690841344 00010000:00010000:2.0:1787387859.476690:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009aea45e0/0x93d41aeaa23c8015 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a40 expref: 8 pid: 6606 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387859.476761:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:2.0:1787387859.476771:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690841344:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387859.476784:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387859.476804:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009aea45e0/0x93d41aeaa23c8015 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a40 expref: 8 pid: 6606 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.476818:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009aea45e0/0x93d41aeaa23c8015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a40 expref: 8 pid: 6606 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.476840:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387859.476845:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387859.476853:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 8 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.476863:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 8 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.476896:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 8 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387859.476909:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5792:1874211709724800:192.168.204.59@tcp:105: 00000100:00100000:2.0:1787387859.476982:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a7000c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787387859.478007:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aea45e0/0x93d41aeaa23c8015 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a40 expref: 8 pid: 6606 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387859.478027:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1874211709724672:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387859.478058:0:6604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 7 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.478070:0:6604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70e00, rc 0) 00000100:00100000:0.0:1787387859.478130:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:11339:x1874211690841216:12345-192.168.204.59@tcp:101:bash.0 Request processed in 5506us (6111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387859.478138:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:2.0:1787387859.480385:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5792:1874211709724800:192.168.204.59@tcp:105: 00010000:00010000:2.0:1787387859.480411:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387859.480518:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690841344:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 3747us (3965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387859.480529:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:2.0:1787387859.484154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387859.484397:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690841600 00000100:00100000:1.0:1787387859.484408:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690841600 00000100:00100000:1.0:1787387859.484468:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:1.0:1787387859.484478:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11339:x1874211690841600:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:1.0:1787387859.485045:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:11339:x1874211690841600:12345-192.168.204.59@tcp:35:bash.0 Request processed in 565us (904us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787387859.485054:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:0.0:1787387859.549939:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387859.549963:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709724928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387859.550037:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387859.550068:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709724928 00000100:00100000:1.0:1787387859.550076:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709724928 00000100:00100000:1.0:1787387859.550137:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787387859.550148:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709724928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787387859.550187:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387859.550260:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709724928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387859.550268:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787387859.550335:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709724928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387859.565320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.565445:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690841856 00000100:00100000:0.0:1787387859.565455:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690841856 00000100:00100000:0.0:1787387859.565511:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:0.0:1787387859.565519:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:11349:x1874211690841856:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387859.565543:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387859.565563:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a4e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387859.565720:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787387859.565906:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8023 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a4e expref: 21 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.565922:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:0.0:1787387859.565925:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787387859.565932:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a4e expref: 21 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.565947:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70c00, rc 0) 00000100:00100000:0.0:1787387859.566007:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:11349:x1874211690841856:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 488us (696us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787387859.566015:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:3.0:1787387859.570514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387859.570704:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690842112 00000100:00100000:1.0:1787387859.570715:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690842112 00000100:00100000:1.0:1787387859.570993:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:1.0:1787387859.571004:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:11349:x1874211690842112:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1787387859.571612:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:11349:x1874211690842112:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 608us (1106us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787387859.571621:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:2.0:1787387859.639704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387859.639888:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690842240 00000100:00100000:3.0:1787387859.639898:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690842240 00000100:00100000:3.0:1787387859.640000:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:3.0:1787387859.640010:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:11355:x1874211690842240:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387859.640035:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387859.640057:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8031 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a55 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.640136:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8038 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.640152:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.640165:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387859.640269:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787387859.640273:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387859.640295:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.640323:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a55 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.640341:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a55 expref: 22 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.640350:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:3.0:1787387859.640353:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387859.640356:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460b400, rc 0) 00000100:00100000:3.0:1787387859.640427:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:11355:x1874211690842240:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 418us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387859.640434:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:2.0:1787387859.646021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.646301:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690842496 00000100:00100000:0.0:1787387859.646313:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690842496 00000100:00100000:0.0:1787387859.646383:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 146 00000100:00100000:0.0:1787387859.646395:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:11355:x1874211690842496:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387859.646416:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387859.646438:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c803f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a5c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.646552:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8046 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.646567:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.646869:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387859.646884:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787387859.647021:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c803f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a5c expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.647039:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a5c expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.647047:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d436f2f6d00) 00010000:00010000:0.0:1787387859.647050:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387859.647053:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71e00, rc 0) 00000100:00100000:0.0:1787387859.647251:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:11355:x1874211690842496:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 857us (1241us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787387859.647259:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 146 00000100:00100000:0.0:1787387859.652053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.652237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387859.652312:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690842880 00000100:00100000:3.0:1787387859.652323:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690842880 00000100:00100000:3.0:1787387859.652387:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 147 00000100:00100000:3.0:1787387859.652397:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:11355:x1874211690842880:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387859.652423:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387859.652445:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8054 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a63 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.652544:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c805b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.652576:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c805b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.652593:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c805b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387859.652607:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787387859.652766:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8054 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a63 expref: 27 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.652784:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c805b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a63 expref: 26 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.652793:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d436f2f6d00) 00010000:00010000:3.0:1787387859.652796:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787387859.652799:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460b200, rc 0) 00000100:00100000:3.0:1787387859.652862:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:11355:x1874211690842880:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 467us (694us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787387859.652868:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 147 00000100:00100000:2.0:1787387859.653587:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690842624 00000100:00100000:2.0:1787387859.653710:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690842624 00000100:00100000:2.0:1787387859.653936:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1787387859.653946:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:2351:x1874211690842624:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387859.653957:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387859.653976:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8046 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a5c expref: 26 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.653990:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d436f2f6d00) 00010000:00010000:2.0:1787387859.653995:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387859.654039:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+25:2351:x1874211690842624:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 96us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387859.654047:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1787387859.658277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387859.658364:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690843008 00000100:00100000:2.0:1787387859.658374:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690843008 00000100:00100000:2.0:1787387859.658433:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:2.0:1787387859.658444:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690843008:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:2.0:1787387859.658506:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.658528:0:6606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 6 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.658536:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787387859.658540:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387859.658545:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.658583:0:6606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 6 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.658725:0:6606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 6 pid: 6604 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387859.659039:0:6606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374489500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6606:1874211709725056:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387859.659190:0:6606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a7000c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387859.662606:0:6606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374489500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6606:1874211709725056:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387859.664912:0:6606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387859.666008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387859.666458:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690843136 00000100:00100000:3.0:1787387859.666467:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690843136 00002000:00100000:3.0:1787387859.666686:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d4372013100 x1874211690843136/t0(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:115/0 lens 504/0 e 0 to 0 dl 1787387870 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787387859.666707:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4372013100 with x1874211690843136 ext(0->12) 00010000:00010000:3.0:1787387859.666719:0:6609:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 7 pid: 6604 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.666778:0:6609:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 7 pid: 6604 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787387859.666786:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4372013100 00000100:00100000:3.0:1787387859.666867:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:3.0:1787387859.666876:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2351:x1874211690843136:12345-192.168.204.59@tcp:4:lfs.0 00000100:00100000:3.0:1787387859.667893:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2351:x1874211690843136:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 1012us (1886us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787387859.667904:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00002000:00100000:3.0:1787387859.667913:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d4372013100 x1874211690843136/t4294967305(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:115/0 lens 504/448 e 0 to 0 dl 1787387870 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787387859.667921:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4372013100 with x1874211690843136 ext(0->12) 00010000:00010000:3.0:1787387859.667929:0:6609:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 9 pid: 6604 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.667943:0:6609:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 9 pid: 6604 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787387859.667950:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4372013100 00000100:00100000:2.0:1787387859.674942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.675412:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690843264 00000100:00100000:0.0:1787387859.675423:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690843264 00010000:00010000:0.0:1787387859.675880:0:11042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 9 pid: 6604 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387859.675933:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:0.0:1787387859.675945:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2351:x1874211690843264:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387859.675962:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787387859.675980:0:11042:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787387859.675983:0:11042:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787387859 00002000:00010000:0.0:1787387859.675985:0:11042:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787387859 00002000:00010000:0.0:1787387859.675987:0:11042:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787387859 00010000:00010000:0.0:1787387859.675992:0:11042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 9 pid: 6604 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.676007:0:11042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 9 pid: 6604 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.676111:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d29ff72/0x93d41aeaa23c801c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a47 expref: 9 pid: 6604 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.676129:0:11042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787387859.676134:0:11042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787387859.676140:0:11042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.676150:0:11042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.676340:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387859.676399:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2351:x1874211690843264:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 456us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387859.676407:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00010000:00010000:2.0:1787387859.676838:0:6606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.676850:0:6606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.676890:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.676899:0:6606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.676907:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.676914:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc200 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387859.676918:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.676926:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.676938:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.676945:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8069 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387859.676997:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690843008:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 18555us (18729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387859.677006:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:1.0:1787387859.680053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387859.680373:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690843520 00000100:00100000:3.0:1787387859.680389:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690843520 00000100:00100000:3.0:1787387859.680461:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1787387859.680473:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4365679450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+25:11355:x1874211690843520:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:3.0:1787387859.680598:0:5810:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c805b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a63 expref: 25 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787387859.681206:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787387859.681340:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787387859.682425:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1787387859.682576:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.682720:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8007 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a39 expref: 29 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.682732:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.682808:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a39 expref: 29 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.682825:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8007 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a39 expref: 29 pid: 6840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387859.682840:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1874211709725184:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387859.683001:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787387859.685961:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1874211709725184:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387859.685992:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387859.686602:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387859.686893:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690843648 00000100:00100000:2.0:1787387859.686902:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690843648 00010000:00010000:2.0:1787387859.686940:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8007 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a39 expref: 30 pid: 6840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387859.686980:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:2.0:1787387859.686990:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+30:2350:x1874211690843648:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387859.687005:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387859.687014:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8007 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a39 expref: 30 pid: 6840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.687157:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a39 expref: 30 pid: 6840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.687191:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8007 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a39 expref: 30 pid: 6840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.687210:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d436f2f6d00) 00010000:00010000:2.0:1787387859.687215:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.687233:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.687241:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387859.687267:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387859.687372:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:2350:x1874211690843648:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 383us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387859.687393:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00010000:00010000:3.0:1787387859.687729:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.687787:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787387859.687946:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787387859.688678:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787387859.688875:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1874211709725312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787387859.688939:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387859.688964:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787387859.690247:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709725312 00000100:00100000:1.0:1787387859.690500:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709725312 00000100:00100000:1.0:1787387859.690572:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787387859.690582:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1874211709725312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787387859.690719:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1874211709725312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 138us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387859.690727:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387859.691018:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1874211709725312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787387859.692284:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787387859.692377:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1874211709725440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787387859.695438:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387859.695496:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387859.695538:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709725440 00000100:00100000:1.0:1787387859.695550:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709725440 00000100:00100000:1.0:1787387859.695637:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787387859.695649:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1874211709725440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787387859.695973:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5810:x1874211709725440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 326us (542us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787387859.695981:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787387859.696474:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1874211709725440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787387859.696557:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787387859.696725:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.696841:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.696851:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.696858:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ae00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387859.696863:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.696871:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.696888:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d436f2f6d00) 00010000:00010000:0.0:1787387859.696892:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787387859.696897:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.696903:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ae00/0x93d41aeaa23c8070 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787387859.697418:0:5810:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787387859.697535:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1787387859.697547:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364146806823ns, next at 365146804391ns, rc = 0 00000001:00080000:0.0:1787387859.697554:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787387859.698305:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d436f2f6d00) 00010000:00010000:0.0:1787387859.698312:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787387859.698322:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b200/0x93d41aeaa23c805b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a63 expref: 33 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387859.698512:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4365679450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+32:11355:x1874211690843520:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 18040us (18467us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787387859.698523:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000020:00080000:0.0:1787387859.698528:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787387859.705219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.706920:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690843776 00000100:00100000:0.0:1787387859.706938:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690843776 00000100:00100000:1.0:1787387859.707182:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 148 00000100:00100000:1.0:1787387859.707194:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+32:11355:x1874211690843776:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1787387859.707233:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387859.707261:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8077 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a6a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.707332:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8077 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a6a expref: 33 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.707347:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8077 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a6a expref: 33 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387859.707366:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:1.0:1787387859.707369:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787387859.707373:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad5000, rc 0) 00000100:00100000:1.0:1787387859.707452:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+33:11355:x1874211690843776:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 260us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387859.707460:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 148 00000100:00100000:1.0:1787387859.712357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387859.712783:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690844032 00000100:00100000:3.0:1787387859.712794:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690844032 00000100:00100000:3.0:1787387859.712854:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:3.0:1787387859.712865:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+33:11355:x1874211690844032:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1787387859.714015:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:11355:x1874211690844032:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 1145us (1785us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787387859.718560:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:2.0:1787387859.807620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387859.807860:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690844288 00000100:00100000:3.0:1787387859.807871:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690844288 00000100:00100000:3.0:1787387859.808074:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 149 00000100:00100000:3.0:1787387859.808086:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:11365:x1874211690844288:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387859.808115:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387859.808142:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c807e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a71 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387859.808295:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787387859.808440:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c807e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a71 expref: 36 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.808456:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:3.0:1787387859.808459:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787387859.808464:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c807e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a71 expref: 36 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.808478:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a600, rc 0) 00000100:00100000:3.0:1787387859.808555:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:11365:x1874211690844288:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 471us (944us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1787387859.808563:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 149 00000100:00100000:0.0:1787387859.812397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387859.812478:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690844416 00000100:00100000:3.0:1787387859.812490:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690844416 00000100:00100000:3.0:1787387859.812547:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:3.0:1787387859.812558:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:11365:x1874211690844416:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:3.0:1787387859.812657:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c808c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.812676:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c808c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.812699:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c808c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.812715:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c8093 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.812723:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c8093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.812769:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c8093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.812876:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c809a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.812885:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c809a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.812893:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c809a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787387859.813075:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c809a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813091:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c808c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813098:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c808c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813105:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c808c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813111:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ba00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387859.813115:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c808c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813122:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c808c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813147:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:3.0:1787387859.813155:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387859.813161:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c808c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813168:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c808c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813183:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c8093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813189:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c8093 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813195:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c8093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813200:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387859.813203:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c8093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813209:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c8093 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813216:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387859.813218:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387859.813231:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c8093 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813236:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c8093 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813251:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c809a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813263:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c809a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813269:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c809a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813274:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387859.813277:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c809a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813283:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c809a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813291:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:3.0:1787387859.813293:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387859.813296:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c809a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.813301:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c809a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387859.813388:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:11365:x1874211690844416:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 829us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387859.813396:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:1.0:1787387859.820317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.820607:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690844672 00000100:00100000:0.0:1787387859.820624:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690844672 00000100:00100000:0.0:1787387859.820684:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:0.0:1787387859.820713:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:11365:x1874211690844672:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1787387859.821049:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:11365:x1874211690844672:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 345us (742us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787387859.821056:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:2.0:1787387859.872205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.872609:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690844928 00000100:00100000:0.0:1787387859.872620:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690844928 00000100:00100000:0.0:1787387859.872695:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00100000:0.0:1787387859.872706:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:11368:x1874211690844928:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387859.872787:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387859.872809:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a78 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.872887:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c80a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.872902:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c80a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.872914:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c80a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.872927:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.872934:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.872941:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873085:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c80b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873094:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c80b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873101:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c80b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387859.873112:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787387859.873245:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c80a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873253:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c80a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873259:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c80a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873265:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387859.873270:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c80a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873277:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c80a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873288:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:0.0:1787387859.873291:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387859.873295:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c80a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873301:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c80a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873314:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873319:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873325:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873340:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387859.873343:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873349:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873357:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c46600) 00010000:00010000:0.0:1787387859.873360:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387859.873363:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873369:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873408:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a78 expref: 39 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873420:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c80b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a78 expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387859.873427:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:0.0:1787387859.873430:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387859.873433:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70200, rc 0) 00000100:00100000:0.0:1787387859.873509:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+38:11368:x1874211690844928:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 804us (1312us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787387859.873517:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00100000:1.0:1787387859.877068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387859.877447:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690845056 00000100:00100000:3.0:1787387859.877457:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690845056 00000100:00100000:3.0:1787387859.877518:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 152 00000100:00100000:3.0:1787387859.877529:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+38:11368:x1874211690845056:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:3.0:1787387859.877612:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.877655:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.877668:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.877705:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.877711:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.877718:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.877723:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387859.877727:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.877735:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.877768:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:3.0:1787387859.877771:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787387859.877775:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387859.877781:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387859.877855:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+38:11368:x1874211690845056:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 328us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387859.877868:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 152 00000100:00100000:1.0:1787387859.883996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387859.884351:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690845312 00000100:00100000:0.0:1787387859.884378:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690845312 00000100:00100000:0.0:1787387859.884441:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:0.0:1787387859.884452:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+38:11368:x1874211690845312:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1787387859.884779:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+39:11368:x1874211690845312:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 328us (791us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787387859.884788:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:2.0:1787387860.158067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387860.158249:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690845568 00000100:00100000:0.0:1787387860.158259:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690845568 00000100:00100000:0.0:1787387860.158320:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:0.0:1787387860.158331:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+39:11399:x1874211690845568:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:0.0:1787387860.158355:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387860.158384:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a7f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.158485:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.158499:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.158510:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387860.158522:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787387860.158652:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a7f expref: 42 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.158673:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a7f expref: 41 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.158713:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:0.0:1787387860.158716:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387860.158719:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70a00, rc 0) 00000100:00100000:0.0:1787387860.158854:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:11399:x1874211690845568:12345-192.168.204.59@tcp:101:cat.0 Request processed in 524us (796us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787387860.158862:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:1.0:1787387860.164298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387860.164338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387860.164424:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690845952 00000100:00100000:0.0:1787387860.164433:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690845952 00000100:00100000:0.0:1787387860.164501:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:0.0:1787387860.164521:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:11399:x1874211690845952:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:0.0:1787387860.164852:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+42:11399:x1874211690845952:12345-192.168.204.59@tcp:35:cat.0 Request processed in 332us (511us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787387860.164861:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:2.0:1787387860.166120:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690845696 00000100:00100000:2.0:1787387860.166131:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690845696 00000100:00100000:2.0:1787387860.166193:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:2.0:1787387860.166202:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+42:2350:x1874211690845696:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387860.166218:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387860.166241:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c80d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a7f expref: 42 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.166260:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:2.0:1787387860.166265:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387860.166309:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:2350:x1874211690845696:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 108us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387860.166315:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1787387860.246457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387860.246709:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690846208 00000100:00100000:3.0:1787387860.246720:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690846208 00000100:00100000:3.0:1787387860.247068:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 154 00000100:00100000:3.0:1787387860.247080:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:11405:x1874211690846208:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:3.0:1787387860.247107:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387860.247109:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787387860.247147:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8038 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a55 expref: 41 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.247174:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:3.0:1787387860.247179:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387860.247193:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a86 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.247291:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.247306:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c80b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a78 expref: 41 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.247314:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.247347:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c80b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a78 expref: 41 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.247360:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c80b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a78 expref: 41 pid: 5809 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387860.247405:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43608e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709725568:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387860.247518:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387860.254109:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43608e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709725568:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387860.254144:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387860.254883:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387860.255050:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690846336 00000100:00100000:3.0:1787387860.255059:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690846336 00010000:00010000:3.0:1787387860.255100:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c80b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a78 expref: 42 pid: 5809 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387860.255131:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:3.0:1787387860.255140:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+42:2350:x1874211690846336:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387860.255156:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387860.255163:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c80b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a78 expref: 42 pid: 5809 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.255445:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c80b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a78 expref: 42 pid: 5809 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.255471:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c80b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a78 expref: 42 pid: 5809 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.255488:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:3.0:1787387860.255494:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.255511:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.255519:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.255556:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387860.255626:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:2350:x1874211690846336:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 486us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387860.255634:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00010000:00010000:2.0:1787387860.256129:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.256138:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387860.256159:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787387860.256337:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c80e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a86 expref: 42 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.256353:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a86 expref: 41 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.256361:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:2.0:1787387860.256364:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787387860.256366:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460b600, rc 0) 00000100:00100000:2.0:1787387860.256413:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:11405:x1874211690846208:12345-192.168.204.59@tcp:101:dd.0 Request processed in 9334us (9964us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787387860.256420:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 154 00000100:00100000:1.0:1787387860.260350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387860.260482:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690846592 00000100:00100000:0.0:1787387860.260493:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690846592 00000100:00100000:0.0:1787387860.260649:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 155 00000100:00100000:0.0:1787387860.260660:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+41:11405:x1874211690846592:12345-192.168.204.59@tcp:36:dd.0 00010000:00010000:0.0:1787387860.261004:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.261024:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.261036:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387860.261115:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787387860.261141:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000098e2e320 reply state 00000000990f18d5 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387860.261150:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387860.261256:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+44:11405:x1874211690846592:12345-192.168.204.59@tcp:36:dd.0 Request processed in 596us (912us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787387860.261264:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 155 00000020:00080000:0.0:1787387860.261270:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787387860.266494:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.266728:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.266839:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.266848:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387860.266853:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.266904:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.266924:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:2.0:1787387860.266927:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387860.267008:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.267016:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c80f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.318176:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387860.394244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387860.394294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387860.394335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387860.394372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387860.394464:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690846848 00000100:00100000:0.0:1787387860.394476:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690846848 00000100:00100000:0.0:1787387860.394556:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690846976 00000100:00100000:0.0:1787387860.394560:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690846976 00000100:00100000:0.0:1787387860.394595:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:0.0:1787387860.394606:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690846848:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387860.394693:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2351:x1874211690846848:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 89us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387860.394700:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:0.0:1787387860.394719:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:0.0:1787387860.394726:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2351:x1874211690846976:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387860.394785:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2351:x1874211690846976:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 59us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387860.394792:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:0.0:1787387860.395202:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690847104 00000100:00100000:0.0:1787387860.395208:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690847104 00000100:00100000:0.0:1787387860.395239:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:0.0:1787387860.395263:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2351:x1874211690847104:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387860.395307:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2351:x1874211690847104:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 46us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387860.395313:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:3.0:1787387860.395491:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690846720 00000100:00100000:3.0:1787387860.395506:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690846720 00000100:00100000:3.0:1787387860.395545:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 301 00000100:00100000:3.0:1787387860.395551:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2351:x1874211690846720:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387860.395584:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2351:x1874211690846720:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 33us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387860.395589:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 301 00000100:00080000:1.0:1787387860.397166:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387860.616155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387860.617264:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690847232 00000100:00100000:3.0:1787387860.617277:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690847232 00000100:00100000:3.0:1787387860.617399:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 156 00000100:00100000:3.0:1787387860.617411:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+43:11419:x1874211690847232:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:3.0:1787387860.617437:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387860.617458:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c80fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a8d expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.617528:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8103 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.617560:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8103 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.617585:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8103 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.617716:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c810a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.617725:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c810a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.617732:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c810a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.617856:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.617876:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a86 expref: 44 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.617885:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.617993:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a86 expref: 44 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.618007:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a86 expref: 44 pid: 5807 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387860.618035:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43608e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709725696:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387860.618961:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387860.631047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387860.631331:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690847488 00000100:00100000:0.0:1787387860.631341:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690847488 00000100:00100000:0.0:1787387860.631404:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:0.0:1787387860.631415:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+45:5566:x1874211690847488:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787387860.631790:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+46:5566:x1874211690847488:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 374us (751us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787387860.631799:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:3.0:1787387860.633515:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43608e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709725696:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387860.633545:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387860.635935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387860.636093:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690847616 00000100:00100000:2.0:1787387860.636102:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690847616 00010000:00010000:2.0:1787387860.636154:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a86 expref: 46 pid: 5807 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387860.636201:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:2.0:1787387860.636210:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+46:2350:x1874211690847616:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387860.636224:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387860.636230:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a86 expref: 46 pid: 5807 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.636243:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a86 expref: 46 pid: 5807 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.636278:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c80e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a86 expref: 46 pid: 5807 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.636296:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:2.0:1787387860.636301:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.636310:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.636330:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387860.636362:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387860.636419:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+45:2350:x1874211690847616:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 208us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387860.636426:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00010000:00010000:3.0:1787387860.637515:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637528:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387860.637587:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787387860.637592:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387860.637623:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637638:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637649:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8103 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637655:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8103 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637661:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8103 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637692:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ba00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387860.637696:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8103 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637703:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8103 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637715:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:3.0:1787387860.637718:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387860.637722:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8103 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637727:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8103 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637776:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c810a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637783:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c810a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637788:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c810a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637794:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387860.637796:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c810a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637802:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c810a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637823:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c2d000) 00010000:00010000:3.0:1787387860.637826:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387860.637829:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c810a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637834:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c810a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637878:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c80fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a8d expref: 45 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637893:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a8d expref: 44 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387860.637900:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:3.0:1787387860.637903:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387860.637905:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a000, rc 0) 00000100:00100000:3.0:1787387860.639271:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+44:11419:x1874211690847232:12345-192.168.204.59@tcp:101:stat.0 Request processed in 21756us (23019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387860.639283:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 156 00000100:00100000:3.0:1787387860.711204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387860.711390:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690847872 00000100:00100000:0.0:1787387860.711400:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690847872 00000100:00100000:0.0:1787387860.711512:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 157 00000100:00100000:0.0:1787387860.711523:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+44:11425:x1874211690847872:12345-192.168.204.59@tcp:36:truncate.0 00010000:00010000:0.0:1787387860.711591:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387860.711619:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8111 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a8d expref: 44 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.711639:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:0.0:1787387860.711644:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387860.711898:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c8118 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.711911:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c8118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.712101:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c8118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387860.712157:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787387860.712184:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001067115f reply state 000000004b1a48c5 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c8118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387860.712194:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387860.712335:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+46:11425:x1874211690847872:12345-192.168.204.59@tcp:36:truncate.0 Request processed in 812us (1140us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787387860.712344:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 157 00000020:00080000:0.0:1787387860.712348:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787387860.713864:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c8118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387860.713878:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c8118 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387860.713886:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c8118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387860.713892:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387860.713896:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c8118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387860.713903:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c8118 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387860.713929:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:1.0:1787387860.713932:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387860.713937:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c8118 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387860.713943:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c8118 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387860.922274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387860.924418:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690848000 00000100:00100000:0.0:1787387860.924436:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690848000 00000100:00100000:0.0:1787387860.924524:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 158 00000100:00100000:0.0:1787387860.924824:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4350d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+45:11439:x1874211690848000:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:0.0:1787387860.924852:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387860.924877:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c811f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a94 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.924948:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8126 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.924961:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.924972:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925004:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c812d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925011:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c812d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925017:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c812d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925128:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925138:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925144:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387860.925186:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787387860.925190:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387860.925217:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925230:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925237:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925243:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8126 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925259:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925265:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387860.925269:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925276:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8126 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925289:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:0.0:1787387860.925292:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387860.925297:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925304:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925320:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c812d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925327:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c812d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925332:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c812d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925337:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387860.925339:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c812d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925354:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c812d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925363:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c46600) 00010000:00010000:0.0:1787387860.925365:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387860.925368:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c812d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925373:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c812d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925409:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c811f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a94 expref: 47 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925424:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a94 expref: 46 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387860.925432:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:0.0:1787387860.925434:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387860.925437:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71c00, rc 0) 00000100:00100000:0.0:1787387860.928877:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4350d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+46:11439:x1874211690848000:12345-192.168.204.59@tcp:101:stat.0 Request processed in 4046us (6604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387860.928892:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 158 00000100:00100000:2.0:1787387861.040518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387861.040641:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690848256 00000100:00100000:0.0:1787387861.040654:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690848256 00000100:00100000:0.0:1787387861.040758:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 159 00000100:00100000:0.0:1787387861.040771:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437448a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+46:11449:x1874211690848256:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387861.040811:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387861.040832:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c813b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52a9b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387861.040965:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787387861.041088:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c813b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a9b expref: 48 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.041102:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:0.0:1787387861.041105:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787387861.041109:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c813b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a9b expref: 48 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.041123:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71400, rc 0) 00000100:00100000:0.0:1787387861.041188:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437448a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+47:11449:x1874211690848256:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 419us (681us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787387861.041195:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 159 00000100:00080000:1.0:1787387861.041735:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387861.054800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387861.054946:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690848512 00000100:00100000:0.0:1787387861.054958:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690848512 00000100:00100000:0.0:1787387861.055027:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:0.0:1787387861.055038:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d436567a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+47:11449:x1874211690848512:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1787387861.055340:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d436567a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+48:11449:x1874211690848512:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 302us (551us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787387861.055348:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:0.0:1787387861.197537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387861.197630:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690848768 00000100:00100000:3.0:1787387861.197640:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690848768 00000100:00100000:3.0:1787387861.197711:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 160 00000100:00100000:3.0:1787387861.197721:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+48:11455:x1874211690848768:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1787387861.197766:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387861.197799:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8149 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52aa2 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.197895:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.197911:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a94 expref: 49 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.197921:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.197956:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a94 expref: 49 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.197968:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a94 expref: 49 pid: 5809 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387861.197981:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709725824:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387861.203056:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387861.205645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387861.205768:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690848896 00000100:00100000:0.0:1787387861.205790:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690848896 00010000:00010000:0.0:1787387861.205828:0:11042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a94 expref: 50 pid: 5809 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387861.205870:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:0.0:1787387861.205879:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+50:2351:x1874211690848896:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387861.205894:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387861.205900:0:11042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a94 expref: 50 pid: 5809 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.205912:0:11042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a94 expref: 50 pid: 5809 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.205936:0:11042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:0.0:1787387861.205941:0:11042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.205950:0:11042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.205957:0:11042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.205973:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387861.206033:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+50:2351:x1874211690848896:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 154us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387861.206040:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00010000:00010000:2.0:1787387861.206470:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71c00/0x93d41aeaa23c8134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a94 expref: 49 pid: 5809 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387861.206489:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709725824:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387861.206510:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.206531:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.206538:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387861.206556:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787387861.206733:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8149 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa2 expref: 50 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.206797:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa2 expref: 49 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.206820:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:2.0:1787387861.206823:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787387861.206827:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a600, rc 0) 00000100:00100000:2.0:1787387861.206883:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+49:11455:x1874211690848768:12345-192.168.204.59@tcp:101:bash.0 Request processed in 9163us (9366us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787387861.206892:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 160 00000100:00100000:3.0:1787387861.216101:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387861.216213:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690849152 00000100:00100000:0.0:1787387861.216224:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690849152 00000100:00100000:0.0:1787387861.216287:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 161 00000100:00100000:0.0:1787387861.216296:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+49:11455:x1874211690849152:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:0.0:1787387861.216576:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c815e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.216594:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c815e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.216607:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c815e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387861.216671:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787387861.216700:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046dde939 reply state 00000000a6e6c143 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c815e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387861.216709:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387861.216832:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:11455:x1874211690849152:12345-192.168.204.59@tcp:36:bash.0 Request processed in 536us (740us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787387861.216839:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 161 00000020:00080000:0.0:1787387861.216844:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787387861.219378:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c815e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.219397:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c815e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.219405:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c815e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.219411:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387861.219416:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c815e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.219424:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c815e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.219440:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:2.0:1787387861.219443:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387861.219447:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c815e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.219464:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c815e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387861.225854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387861.226013:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690849280 00000100:00100000:0.0:1787387861.226025:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690849280 00000100:00100000:0.0:1787387861.226092:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 162 00000100:00100000:0.0:1787387861.226103:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+51:11455:x1874211690849280:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1787387861.226128:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387861.226148:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8165 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52aa9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.226242:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c816c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.226273:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa2 expref: 52 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.226281:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c816c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.226317:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa2 expref: 52 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.226330:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa2 expref: 52 pid: 6840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387861.226344:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709725952:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387861.226437:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1787387861.230471:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709725952:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387861.230504:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c816c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387861.232363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387861.233143:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690849408 00000100:00100000:0.0:1787387861.233154:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690849408 00010000:00010000:0.0:1787387861.233210:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa2 expref: 53 pid: 6840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387861.233258:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:0.0:1787387861.233268:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+53:2350:x1874211690849408:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387861.233287:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387861.233307:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa2 expref: 53 pid: 6840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.233321:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa2 expref: 53 pid: 6840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.233346:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8150 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa2 expref: 53 pid: 6840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.233363:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:0.0:1787387861.233369:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c816c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.233380:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c816c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.233387:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c816c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.233423:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387861.233835:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c816c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.233845:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c816c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387861.233902:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787387861.233906:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387861.233931:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c816c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.233963:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8165 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa9 expref: 53 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.233979:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c816c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa9 expref: 52 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.233986:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:3.0:1787387861.233988:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387861.233991:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71000, rc 0) 00000100:00100000:0.0:1787387861.234091:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:2350:x1874211690849408:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 823us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387861.234100:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:3.0:1787387861.235032:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+51:11455:x1874211690849280:12345-192.168.204.59@tcp:101:bash.0 Request processed in 8927us (9187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387861.235042:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 162 00000100:00100000:1.0:1787387861.239718:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387861.240411:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690849664 00000100:00100000:0.0:1787387861.240423:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690849664 00000100:00100000:0.0:1787387861.240714:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:0.0:1787387861.240727:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+51:11455:x1874211690849664:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:0.0:1787387861.241029:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:11455:x1874211690849664:12345-192.168.204.59@tcp:35:bash.0 Request processed in 304us (1319us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1787387861.241049:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:1.0:1787387861.320140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387861.320429:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690849920 00000100:00100000:0.0:1787387861.320443:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690849920 00000100:00100000:0.0:1787387861.320516:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:0.0:1787387861.320536:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:11465:x1874211690849920:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387861.320563:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387861.320586:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8173 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52ab0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387861.320718:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787387861.320871:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8173 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ab0 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.320888:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:0.0:1787387861.320890:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787387861.320895:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8173 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ab0 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.320908:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71a00, rc 0) 00000100:00100000:0.0:1787387861.320973:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+53:11465:x1874211690849920:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 439us (843us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787387861.320981:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:3.0:1787387861.323970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387861.324170:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690850048 00000100:00100000:2.0:1787387861.324181:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690850048 00000100:00100000:2.0:1787387861.324729:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00100000:2.0:1787387861.324902:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+53:11465:x1874211690850048:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:2.0:1787387861.324987:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8181 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325005:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325018:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325032:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8188 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325039:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325046:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325239:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c818f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325249:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c818f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325257:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c818f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787387861.325466:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c818f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325479:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325486:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8181 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325493:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325499:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387861.325503:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325510:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8181 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325521:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:2.0:1787387861.325524:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387861.325529:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325535:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8181 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325548:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325554:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8188 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325705:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325710:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387861.325713:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325720:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8188 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325729:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d436f2f6900) 00010000:00010000:2.0:1787387861.325732:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387861.325735:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8188 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325772:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8188 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325791:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c818f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325797:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c818f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325802:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c818f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325807:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387861.325810:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c818f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325827:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c818f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325835:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:2.0:1787387861.325838:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387861.325841:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c818f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.325847:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c818f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387861.326009:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+53:11465:x1874211690850048:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 1268us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387861.326019:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00100000:1.0:1787387861.337857:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387861.338012:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690850304 00000100:00100000:3.0:1787387861.338023:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690850304 00000100:00100000:3.0:1787387861.338076:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:3.0:1787387861.338086:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+53:11465:x1874211690850304:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1787387861.338893:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:11465:x1874211690850304:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 804us (1041us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787387861.338901:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00010000:00010000:2.0:1787387861.342415:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387861.375438:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387861.375573:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690850560 00000100:00100000:0.0:1787387861.375587:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690850560 00000100:00100000:0.0:1787387861.375652:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 165 00000100:00100000:0.0:1787387861.375672:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:11468:x1874211690850560:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387861.375714:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387861.375889:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8196 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52ab7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.375983:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c819d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.375995:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c819d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.376006:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c819d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.376019:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c81a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.376025:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c81a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.376031:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c81a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.376173:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c81ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.376182:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c81ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.376188:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c81ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387861.376199:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787387861.376654:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c819d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.376674:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c819d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.377084:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c819d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.377091:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387861.377095:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c819d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379778:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c819d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379810:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:0.0:1787387861.379813:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387861.379817:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c819d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379824:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c819d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379845:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c81a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379851:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c81a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379857:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c81a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379861:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387861.379881:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c81a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379887:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c81a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379894:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c46600) 00010000:00010000:0.0:1787387861.379896:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387861.379898:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c81a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379903:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c81a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379970:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8196 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ab7 expref: 57 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379983:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c81ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ab7 expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.379989:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:0.0:1787387861.379991:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387861.379993:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70e00, rc 0) 00000100:00100000:0.0:1787387861.380066:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:11468:x1874211690850560:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 4396us (4643us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787387861.380075:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 165 00000100:00100000:2.0:1787387861.390643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387861.390810:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690850688 00000100:00100000:3.0:1787387861.390836:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690850688 00000100:00100000:3.0:1787387861.390898:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 166 00000100:00100000:3.0:1787387861.390908:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:11468:x1874211690850688:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:3.0:1787387861.390990:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c81b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.391009:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c81b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.391021:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c81b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.391052:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c81b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.391058:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c81b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.391065:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c81b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.391070:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ba00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387861.391075:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c81b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.391081:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c81b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.391093:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:3.0:1787387861.391095:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787387861.391100:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c81b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.391117:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c81b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387861.391188:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:11468:x1874211690850688:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 281us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387861.391197:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 166 00000100:00100000:1.0:1787387861.395146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387861.396480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387861.396573:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690851072 00000100:00100000:1.0:1787387861.396585:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690851072 00000100:00100000:1.0:1787387861.396644:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:1.0:1787387861.396655:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:11468:x1874211690851072:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1787387861.397034:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:11468:x1874211690851072:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 379us (559us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787387861.397043:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:0.0:1787387861.398893:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690850816 00000100:00100000:0.0:1787387861.398907:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690850816 00000100:00100000:0.0:1787387861.398979:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1787387861.398990:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:2353:x1874211690850816:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387861.399026:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387861.399051:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c81ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ab7 expref: 57 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387861.399072:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:0.0:1787387861.399077:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387861.399425:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:2353:x1874211690850816:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 436us (4288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387861.399433:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:1.0:1787387861.587247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387861.587625:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690851328 00000100:00100000:2.0:1787387861.587636:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690851328 00000100:00100000:2.0:1787387861.587713:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 167 00000100:00100000:2.0:1787387861.587723:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:11486:x1874211690851328:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:2.0:1787387861.587778:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387861.587807:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52abe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.587927:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c81c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.587942:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c81c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.587971:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c81c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387861.587984:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787387861.588143:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52abe expref: 59 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.588864:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c81c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52abe expref: 58 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.588879:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:2.0:1787387861.588882:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787387861.588886:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fd000, rc 0) 00000100:00100000:2.0:1787387861.588975:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+58:11486:x1874211690851328:12345-192.168.204.59@tcp:101:cat.0 Request processed in 1252us (1737us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787387861.588984:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 167 00000100:00100000:2.0:1787387861.653389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387861.653789:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690851456 00000100:00100000:1.0:1787387861.653799:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690851456 00000100:00100000:1.0:1787387861.653864:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:1.0:1787387861.653875:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+58:11487:x1874211690851456:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1787387861.653901:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387861.653923:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52ac5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387861.653999:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c81dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387861.654014:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c81dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387861.654026:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c81dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387861.654238:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787387861.654243:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787387861.654321:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c81dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387861.654395:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ac5 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387861.654414:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c81dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ac5 expref: 59 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387861.654423:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:1.0:1787387861.654426:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787387861.654430:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4a00, rc 0) 00000100:00100000:1.0:1787387861.671089:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:11487:x1874211690851456:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 17198us (17691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387861.671241:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:3.0:1787387861.676722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387861.676782:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690851840 00000100:00100000:3.0:1787387861.676792:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690851840 00000100:00100000:3.0:1787387861.676846:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1787387861.676856:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:11487:x1874211690851840:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1787387861.677429:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:11487:x1874211690851840:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 572us (715us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787387861.677439:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1787387861.686675:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387861.686717:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690851968 00000100:00100000:3.0:1787387861.686728:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690851968 00000100:00100000:3.0:1787387861.686823:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1787387861.686833:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:11487:x1874211690851968:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:3.0:1787387861.686852:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787387861.686881:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c816c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aa9 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.686916:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c81c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52abe expref: 59 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.686952:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8077 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a6a expref: 58 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.686963:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720000) 00010000:00010000:3.0:1787387861.686976:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387861.687032:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:11487:x1874211690851968:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 200us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387861.687040:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:2.0:1787387861.696831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387861.697146:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690852096 00000100:00100000:1.0:1787387861.697157:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690852096 00000100:00100000:1.0:1787387861.697223:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 169 00000100:00100000:1.0:1787387861.697233:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:11487:x1874211690852096:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:1.0:1787387861.697369:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387861.697388:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387861.697401:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787387861.698414:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787387861.698522:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:11487:x1874211690852096:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 1285us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387861.698533:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 169 00000001:00080000:1.0:1787387861.707183:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1787387861.707207:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1787387861.711711:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000004:00080000:0.0:1787387861.711829:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:0.0:1787387861.711884:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000001:00080000:0.0:1787387861.711895:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000020:00080000:0.0:1787387861.711915:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d4373bb8600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787387861.711920:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d435840f300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d4373bb8000 00000020:00080000:0.0:1787387861.711923:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d435840f200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d43464b4400 00000020:00080000:1.0:1787387861.712269:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787387861.712445:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787387861.719082:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709726080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787387861.719176:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387861.719490:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709726080 00000100:00100000:3.0:1787387861.719499:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709726080 00000100:00100000:3.0:1787387861.719617:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787387861.719628:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709726080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787387861.719669:0:6604:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1787387861.719706:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a895fd3, atime: 0x6a895fd3, ctime: 0x6a895fd3, blocks: 0xb 00010000:00010000:3.0:1787387861.719716:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c81ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.719732:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:3.0:1787387861.719775:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387861.719782:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c81ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.719817:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c81ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.719827:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c81ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.719834:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c81ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387861.719849:0:6604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787387861.720415:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874211709726080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 788us (1237us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787387861.720432:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787387861.720504:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787387861.720567:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387861.720576:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c81ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.720585:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ba00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387861.720590:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c81ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.720607:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c81ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.720627:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c81ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.720634:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c81ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.720665:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387861.720667:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387861.720668:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387861.720702:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787387861.720708:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787387861.720728:0:3311:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d437a087b80 x1874211709726080/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787387877 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787387861.720780:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d437a087b80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787387861.720786:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709726080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787387861.739723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387861.739896:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690852224 00000100:00100000:2.0:1787387861.739907:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690852224 00000100:00100000:2.0:1787387861.739973:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 170 00000100:00100000:2.0:1787387861.739985:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+16:11489:x1874211690852224:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1787387861.740010:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387861.740038:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c81f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52acc expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740141:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740158:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740171:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740188:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c81ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740195:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c81ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740203:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c81ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740603:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740614:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740621:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387861.740671:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787387861.740676:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787387861.740699:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740722:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740731:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740774:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740783:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740789:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387861.740793:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740801:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740814:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:2.0:1787387861.740817:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387861.740822:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740829:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c81f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740843:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c81ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740849:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c81ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740861:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c81ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740867:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387861.740870:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c81ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740876:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c81ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740885:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d436f2f6900) 00010000:00010000:2.0:1787387861.740887:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387861.740890:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c81ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740895:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c81ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740929:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c81f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52acc expref: 18 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740944:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52acc expref: 17 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387861.740951:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720300) 00010000:00010000:2.0:1787387861.740953:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787387861.740956:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fda00, rc 0) 00000100:00100000:2.0:1787387861.741036:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:11489:x1874211690852224:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1052us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387861.741052:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 170 00010000:00010000:2.0:1787387862.367554:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787387862.598130:0:12334:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787387862.598140:0:12334:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787387862.598174:0:12334:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787387862.598179:0:12334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787387862.685983:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787387862.685991:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787387862.686050:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787387862.686055:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787387862.686183:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709726208:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787387862.686271:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387862.690612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.690720:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690852352 00000100:00100000:3.0:1787387862.690730:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690852352 00000100:00100000:3.0:1787387862.690797:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 171 00000100:00100000:3.0:1787387862.690807:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11501:x1874211690852352:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787387862.690853:0:5808:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787387862.690966:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11501:x1874211690852352:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 159us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387862.690975:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 171 00000100:00100000:1.0:1787387862.691643:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709726208:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787387862.701795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387862.703821:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690852480 00000100:00100000:1.0:1787387862.703839:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690852480 00000100:00100000:1.0:1787387862.703925:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:1.0:1787387862.703939:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:11501:x1874211690852480:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787387862.704028:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c820d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704046:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c820d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704062:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c820d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704079:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8214 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704086:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8214 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704093:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8214 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704121:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c821b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704139:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c821b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704147:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c821b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387862.704187:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787387862.704191:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787387862.704202:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c821b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704213:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c820d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704220:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c820d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704226:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c820d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704233:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387862.704237:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c820d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704244:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c820d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704257:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:1.0:1787387862.704260:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387862.704264:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c820d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704282:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4400/0x93d41aeaa23c820d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704294:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8214 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704300:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8214 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704305:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8214 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704309:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387862.704312:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8214 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704318:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8214 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704326:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8d4358720a00) 00010000:00010000:1.0:1787387862.704328:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387862.704331:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8214 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704337:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5000/0x93d41aeaa23c8214 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704351:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c821b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704357:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c821b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704369:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c821b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704374:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387862.704377:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c821b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704383:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c821b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704390:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720300) 00010000:00010000:1.0:1787387862.704392:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387862.704505:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c821b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.704512:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c821b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387862.705520:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:11501:x1874211690852480:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 1576us (3728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387862.705544:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:0.0:1787387862.716695:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.718317:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690852736 00000100:00100000:3.0:1787387862.718331:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690852736 00000100:00100000:3.0:1787387862.718495:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 173 00000100:00100000:3.0:1787387862.718507:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:11501:x1874211690852736:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387862.718603:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387862.718628:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8222 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52ad3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.718770:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8229 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.718786:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.718798:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387862.718810:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787387862.718912:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.718920:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8229 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.718942:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.718948:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387862.718953:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.718962:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8229 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.718976:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720300) 00010000:00010000:3.0:1787387862.718979:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387862.718984:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8229 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.718990:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8229 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.719027:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8222 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ad3 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.719037:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:3.0:1787387862.719040:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787387862.719045:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8222 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ad3 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.719055:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460aa00, rc 0) 00000100:00100000:2.0:1787387862.719808:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11501:x1874211690852736:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1299us (3119us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1787387862.719819:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 173 00000100:00100000:3.0:1787387862.726763:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387862.726851:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690852864 00000100:00100000:0.0:1787387862.726862:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690852864 00000100:00100000:0.0:1787387862.726930:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 174 00000100:00100000:0.0:1787387862.726943:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11501:x1874211690852864:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787387862.726983:0:6840:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787387862.727138:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11501:x1874211690852864:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 199us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387862.727146:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 174 00000100:00100000:3.0:1787387862.731933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387862.732244:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690853120 00000100:00100000:1.0:1787387862.732258:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690853120 00000100:00100000:1.0:1787387862.732317:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 175 00000100:00100000:1.0:1787387862.732328:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11501:x1874211690853120:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787387862.732349:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387862.732353:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787387862.732381:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4a00/0x93d41aeaa23c81dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ac5 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.732415:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:1.0:1787387862.732419:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787387862.732434:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8237 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52ada expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787387862.733290:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787387862.733562:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c823e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.733576:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c823e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.733587:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c823e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.733659:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8237 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ada expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.733676:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c823e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ada expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.733683:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4358720a00) 00010000:00010000:1.0:1787387862.733686:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787387862.733688:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e800, rc 0) 00000100:00100000:1.0:1787387862.733787:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:11501:x1874211690853120:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1459us (1863us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787387862.733796:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 175 00000100:00100000:0.0:1787387862.738306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.738437:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690853376 00000100:00100000:3.0:1787387862.738448:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690853376 00000100:00100000:3.0:1787387862.738513:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 176 00000100:00100000:3.0:1787387862.738523:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:11501:x1874211690853376:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787387862.738596:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387862.738624:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c823e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ada expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.738654:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4358720a00) 00010000:00010000:3.0:1787387862.738666:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787387862.738690:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c824c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.738703:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c824c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.738713:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c824c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.738727:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8253 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xcd8e5e08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.738733:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcd8e5e08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.738760:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcd8e5e08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739018:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c824c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739035:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c824c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739040:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c824c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739046:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460aa00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387862.739051:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c824c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739057:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c824c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739066:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:3.0:1787387862.739068:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387862.739084:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c824c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739090:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c824c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739100:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcd8e5e08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739105:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8253 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcd8e5e08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739111:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8253 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcd8e5e08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739115:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387862.739123:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8253 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcd8e5e08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739130:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8253 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcd8e5e08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739137:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xcd8e5e08 (ffff8d4343c2d800) 00010000:00010000:3.0:1787387862.739140:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387862.739142:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8253 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcd8e5e08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.739148:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8253 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcd8e5e08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387862.739229:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11501:x1874211690853376:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 707us (934us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787387862.739237:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 176 00000100:00100000:1.0:1787387862.744602:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387862.744683:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690853504 00000100:00100000:0.0:1787387862.744693:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690853504 00000100:00100000:0.0:1787387862.744778:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00100000:0.0:1787387862.744788:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11501:x1874211690853504:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787387862.744811:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387862.744837:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c825a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52ae1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.744878:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8261 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.744891:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.744902:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.745010:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c825a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae1 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.745029:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8261 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae1 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.745038:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4343c46900) 00010000:00010000:0.0:1787387862.745041:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787387862.745052:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70c00, rc 0) 00000100:00100000:0.0:1787387862.745430:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:11501:x1874211690853504:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 641us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387862.745438:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00100000:2.0:1787387862.753109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.754167:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690853760 00000100:00100000:3.0:1787387862.754179:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690853760 00000100:00100000:3.0:1787387862.754247:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 178 00000100:00100000:3.0:1787387862.754258:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:11501:x1874211690853760:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787387862.754344:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.754361:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.754374:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787387862.755946:0:6840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787387862.755968:0:6840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367205228416ns, next at 368205226421ns, rc = 0 00000004:00010000:3.0:1787387862.756067:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae55fcf4 reply state 00000000850a74f8 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387862.756081:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787387862.757728:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:11501:x1874211690853760:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 3460us (4615us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787387862.757752:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 178 00000100:00100000:1.0:1787387862.769051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:1.0:1787387862.769094:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.769106:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8268 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.769115:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.769121:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ac00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387862.769127:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.769135:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8268 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.769157:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4343c46900) 00010000:00010000:1.0:1787387862.769160:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787387862.769167:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8268 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.769173:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8268 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387862.769212:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690853888 00000100:00100000:1.0:1787387862.769223:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690853888 00000100:00100000:1.0:1787387862.769278:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 179 00000100:00100000:1.0:1787387862.769288:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:11501:x1874211690853888:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787387862.769312:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387862.769337:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c826f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52ae8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.769400:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c826f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae8 expref: 21 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.769413:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c826f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae8 expref: 21 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.769432:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4343c46900) 00010000:00010000:1.0:1787387862.769435:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787387862.769438:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e600, rc 0) 00000100:00100000:1.0:1787387862.769501:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:11501:x1874211690853888:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 215us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387862.769508:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 179 00000100:00100000:3.0:1787387862.780930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.780966:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690854016 00000100:00100000:3.0:1787387862.780976:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690854016 00000100:00100000:3.0:1787387862.781032:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:3.0:1787387862.781041:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690854016:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787387862.783535:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690854016:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 2484us (2604us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787387862.783549:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00080000:3.0:1787387862.783588:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387862.792281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387862.792319:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690854272 00000100:00100000:1.0:1787387862.792330:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690854272 00000100:00100000:1.0:1787387862.792379:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:1.0:1787387862.792389:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:11501:x1874211690854272:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787387862.792670:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:11501:x1874211690854272:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 281us (396us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1787387862.792677:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:1.0:1787387862.797698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387862.797753:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690854528 00000100:00100000:1.0:1787387862.797764:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690854528 00000100:00100000:1.0:1787387862.797821:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 180 00000100:00100000:1.0:1787387862.797832:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:11501:x1874211690854528:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787387862.797972:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:11501:x1874211690854528:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 141us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387862.797981:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 180 00000100:00100000:2.0:1787387862.801727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.802395:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690854656 00000100:00100000:3.0:1787387862.802407:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690854656 00000100:00100000:3.0:1787387862.802476:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:3.0:1787387862.802488:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:11501:x1874211690854656:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387862.802508:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387862.802543:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8276 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52aef expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.802615:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c827d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.802655:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c827d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.802667:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c827d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387862.802707:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387862.802726:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c827d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.802775:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8276 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aef expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.802790:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c827d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aef expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.802800:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4343c46900) 00010000:00010000:3.0:1787387862.802803:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787387862.802807:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460aa00, rc 0) 00000100:00100000:3.0:1787387862.802892:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:11501:x1874211690854656:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 406us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387862.802900:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:1.0:1787387862.811727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387862.811966:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690854784 00000100:00100000:0.0:1787387862.811979:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690854784 00000100:00100000:0.0:1787387862.812087:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1787387862.812099:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690854784:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787387862.812119:0:11067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387862.812144:0:11067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a6d4425/0x93d41aeaa23c8284 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52af6 expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787387862.812177:0:11067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a895fd6, blocks: 0x1 00010000:00010000:0.0:1787387862.812199:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1787387862.812204:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387862.812214:0:11067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a6d4425/0x93d41aeaa23c8284 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52af6 expref: 8 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.812235:0:11067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a6d4425/0x93d41aeaa23c8284 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52af6 expref: 8 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.812250:0:11067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70800, rc 0) 00000100:00100000:0.0:1787387862.812323:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690854784:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 226us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387862.812330:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:1.0:1787387862.816514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.816698:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690855040 00000100:00100000:3.0:1787387862.816710:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690855040 00000100:00100000:3.0:1787387862.817002:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:3.0:1787387862.817016:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:11501:x1874211690855040:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787387862.817216:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:11501:x1874211690855040:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 201us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387862.817238:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:2.0:1787387862.820397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.820506:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690855168 00000100:00100000:3.0:1787387862.820518:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690855168 00000100:00100000:3.0:1787387862.820708:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:3.0:1787387862.820719:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:11501:x1874211690855168:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387862.820789:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387862.820816:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52afd expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.820855:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a6d4425/0x93d41aeaa23c8284 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52af6 expref: 9 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.820864:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387862.820868:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387862.820873:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 9 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.820908:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a6d4425/0x93d41aeaa23c8284 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52af6 expref: 9 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.820922:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a6d4425/0x93d41aeaa23c8284 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52af6 expref: 9 pid: 11067 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387862.820937:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6605:1874211709726336:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387862.821039:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787387862.823789:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6605:1874211709726336:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387862.823831:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 9 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.823854:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460b800, rc 0) 00000100:00100000:3.0:1787387862.823918:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:11501:x1874211690855168:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 3201us (3532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387862.823927:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:1.0:1787387862.827020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387862.827237:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690855296 00000100:00100000:0.0:1787387862.827262:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690855296 00010000:00010000:0.0:1787387862.827303:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a6d4425/0x93d41aeaa23c8284 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52af6 expref: 9 pid: 11067 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387862.827377:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:0.0:1787387862.827387:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f658a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2350:x1874211690855296:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387862.827406:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387862.827430:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a6d4425/0x93d41aeaa23c8284 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52af6 expref: 9 pid: 11067 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.827443:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a6d4425/0x93d41aeaa23c8284 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52af6 expref: 9 pid: 11067 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.827469:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a6d4425/0x93d41aeaa23c8284 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52af6 expref: 9 pid: 11067 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.827485:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387862.827489:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387862.827498:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.827509:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.827566:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387862.827594:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4343525500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5793:1874211709726464:192.168.204.59@tcp:105: 00000100:00100000:0.0:1787387862.827691:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387862.832209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.832309:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4343525500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5793:1874211709726464:192.168.204.59@tcp:105: 00010000:00010000:3.0:1787387862.832334:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387862.832395:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f658a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690855296:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 5008us (5386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387862.832406:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:1.0:1787387862.832710:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690855424 00000100:00100000:1.0:1787387862.832719:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690855424 00002000:00100000:1.0:1787387862.832806:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d43747ca680 x1874211690855424/t0(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:118/0 lens 504/0 e 0 to 0 dl 1787387873 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787387862.832818:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d43747ca680 with x1874211690855424 ext(0->8) 00002000:00010000:1.0:1787387862.832824:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d43747ca680 00000100:00100000:1.0:1787387862.832852:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1787387862.832863:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690855424:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787387862.833313:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:2350:x1874211690855424:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 451us (1112us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787387862.833320:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00002000:00100000:1.0:1787387862.833327:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d43747ca680 x1874211690855424/t4294967314(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:118/0 lens 504/448 e 0 to 0 dl 1787387873 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787387862.833335:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d43747ca680 with x1874211690855424 ext(0->8) 00002000:00010000:1.0:1787387862.833339:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d43747ca680 00000100:00100000:1.0:1787387862.836446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.837146:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690855552 00000100:00100000:3.0:1787387862.837158:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690855552 00000100:00100000:2.0:1787387862.837396:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 183 00000100:00100000:2.0:1787387862.837410:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:11501:x1874211690855552:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787387862.874858:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1787387862.874884:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1787387862.874904:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1787387862.875100:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709726592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787387862.875174:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387862.875233:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709726592 00000100:00100000:0.0:1787387862.875241:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709726592 00000100:00100000:0.0:1787387862.875301:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787387862.875309:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709726592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787387862.875479:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787387862.875482:0:6604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787387862 00002000:00010000:0.0:1787387862.875485:0:6604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787387862.875487:0:6604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787387862 -> 1787387862 00002000:00010000:0.0:1787387862.875489:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787387862.875546:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709726592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 237us (371us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787387862.875553:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787387862.875576:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787387862.875612:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d437f6cc380/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787387862.875618:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709726592:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1787387862.875828:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787387862.875845:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787387862.876022:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11501:x1874211690855552:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 38613us (39584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387862.876033:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 183 00000100:00100000:1.0:1787387862.878733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387862.878844:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690855680 00000100:00100000:2.0:1787387862.878855:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690855680 00000100:00100000:2.0:1787387862.878918:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:2.0:1787387862.878929:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:2351:x1874211690855680:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787387862.917596:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1787387862.917620:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1787387862.917960:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2351:x1874211690855680:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 39025us (39228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387862.917974:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:0.0:1787387862.921659:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387862.922344:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690855936 00000100:00100000:1.0:1787387862.922357:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690855936 00000100:00100000:1.0:1787387862.922462:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 184 00000100:00100000:1.0:1787387862.922474:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11501:x1874211690855936:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787387862.922548:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387862.922578:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c827d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52aef expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.922599:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4343c46900) 00010000:00010000:1.0:1787387862.922604:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787387862.922647:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8292 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.922661:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.922672:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787387862.923044:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061c838d8 reply state 000000007ca3f538 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387862.923055:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787387862.923312:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:11501:x1874211690855936:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 839us (1661us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787387862.923322:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 184 00000100:00100000:1.0:1787387862.927254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:2.0:1787387862.927375:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.927389:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8292 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.927407:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.927413:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387862.927417:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.927426:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8292 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.927444:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4343c46900) 00010000:00010000:2.0:1787387862.927448:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387862.927452:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8292 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.927459:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8292 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387862.927589:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690856064 00000100:00100000:0.0:1787387862.927604:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690856064 00000100:00100000:0.0:1787387862.927694:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:0.0:1787387862.927704:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2351:x1874211690856064:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787387862.928011:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787387862.928016:0:6604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787387862 -> 1787387861 00002000:00010000:0.0:1787387862.928018:0:6604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787387859 00002000:00010000:0.0:1787387862.928021:0:6604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787387862 -> 1787387861 00002000:00010000:0.0:1787387862.928023:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787387862.928171:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2351:x1874211690856064:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 467us (924us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787387862.928179:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:1.0:1787387862.930483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.930579:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690856320 00000100:00100000:3.0:1787387862.930589:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690856320 00000100:00100000:3.0:1787387862.930656:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 185 00000100:00100000:3.0:1787387862.930665:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11501:x1874211690856320:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787387862.930764:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.930784:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8261 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae1 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.930794:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.930850:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8261 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae1 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.930864:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8261 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae1 expref: 18 pid: 5807 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387862.930878:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709726720:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387862.930971:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4381d69240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387862.933602:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709726720:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387862.933647:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387862.934578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387862.934936:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690856448 00000100:00100000:2.0:1787387862.934950:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690856448 00010000:00010000:2.0:1787387862.934994:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8261 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae1 expref: 19 pid: 5807 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387862.935024:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:2.0:1787387862.935032:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:2351:x1874211690856448:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387862.935047:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387862.935053:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8261 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae1 expref: 19 pid: 5807 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.935097:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8261 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae1 expref: 19 pid: 5807 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.935121:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c8261 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae1 expref: 19 pid: 5807 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.935138:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4343c46900) 00010000:00010000:2.0:1787387862.935144:0:8324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.935154:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.935161:0:8324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.935193:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387862.935245:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:2351:x1874211690856448:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 213us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387862.935253:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00010000:00010000:1.0:1787387862.936206:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.936219:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.936255:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.936262:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.936269:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.936276:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387862.936281:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.936289:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.936302:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4343c46900) 00010000:00010000:1.0:1787387862.936305:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787387862.936308:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.936314:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c8299 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387862.936390:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:11501:x1874211690856320:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 5724us (5913us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787387862.936413:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 185 00000100:00100000:1.0:1787387862.939470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.939556:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690856576 00000100:00100000:3.0:1787387862.939567:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690856576 00000100:00100000:3.0:1787387862.939634:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:3.0:1787387862.939644:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f65b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690856576:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787387862.939699:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.939718:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.939725:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387862.939729:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787387862.939734:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.939823:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.939838:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 8 pid: 6605 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387862.939856:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6605:1874211709726848:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387862.939940:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4381d69240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387862.946416:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6605:1874211709726848:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387862.946456:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387862.948318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387862.948421:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690856704 00000100:00100000:2.0:1787387862.948431:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690856704 00010000:00010000:2.0:1787387862.948478:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 9 pid: 6605 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387862.948520:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:2.0:1787387862.948536:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f658a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2352:x1874211690856704:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387862.948572:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387862.948597:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 9 pid: 6605 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.948611:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 9 pid: 6605 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.948651:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c828b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52afd expref: 9 pid: 6605 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.948672:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387862.948677:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387862.948683:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.948694:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.948786:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387862.948846:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f658a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2352:x1874211690856704:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 316us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387862.948853:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00010000:00010000:0.0:1787387862.949009:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.949020:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.949049:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.949058:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.949066:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.949088:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387862.949093:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.949102:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.949116:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.949124:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c82a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387862.949187:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f65b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690856576:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 9545us (9727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387862.949198:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:1.0:1787387862.954853:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.955337:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690856960 00000100:00100000:3.0:1787387862.955349:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690856960 00000100:00100000:3.0:1787387862.955415:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:3.0:1787387862.955426:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+17:11501:x1874211690856960:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787387862.955514:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.955543:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.955557:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.955847:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.955873:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c826f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae8 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.955881:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.955915:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c826f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae8 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.955929:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c826f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae8 expref: 18 pid: 5808 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387862.955945:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709726976:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387862.956177:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4381d69240 going to sleep for 11 seconds 00000100:00100000:2.0:1787387862.961229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387862.961367:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690857088 00000100:00100000:0.0:1787387862.961378:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690857088 00010000:00010000:0.0:1787387862.961428:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c826f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae8 expref: 19 pid: 5808 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387862.961478:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:0.0:1787387862.961489:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:2350:x1874211690857088:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387862.961509:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387862.961515:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c826f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae8 expref: 19 pid: 5808 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.961558:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c826f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae8 expref: 19 pid: 5808 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.961581:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4343c46900) 00010000:00010000:0.0:1787387862.961587:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.961595:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.961602:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387862.961621:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387862.961694:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:2350:x1874211690857088:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 207us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387862.961702:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 70 00010000:00010000:3.0:1787387862.962953:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e600/0x93d41aeaa23c826f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ae8 expref: 18 pid: 5808 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387862.962977:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709726976:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387862.963004:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.963317:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.963325:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787387862.963656:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1787387862.963994:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787387862.964038:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787387862.964277:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1874211709727104:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787387862.964342:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387862.964420:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374241480 going to sleep for 11 seconds 00000100:00100000:1.0:1787387862.964460:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709727104 00000100:00100000:1.0:1787387862.964466:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709727104 00000100:00100000:1.0:1787387862.964545:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787387862.964553:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1874211709727104:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787387862.964655:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1874211709727104:12345-0@lo:1000:mdt00_002.0 Request processed in 102us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387862.964662:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387862.964719:0:5809:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787387862.964725:0:5809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d437f6cc380, transno 4294967315 00000100:00100000:2.0:1787387862.964763:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1874211709727104:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787387862.965327:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787387862.965395:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1874211709727232:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787387862.965433:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387862.966619:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43742419c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387862.966665:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709727232 00000100:00100000:3.0:1787387862.966675:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709727232 00000100:00100000:0.0:1787387862.966957:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387862.966968:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5809:x1874211709727232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787387862.967208:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1874211709727232:12345-0@lo:1000:mdt00_002.0 Request processed in 242us (1773us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787387862.967216:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387862.967289:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1874211709727232:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787387862.967330:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967341:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967348:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967354:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460be00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387862.967358:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967365:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967394:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4343c46900) 00010000:00010000:2.0:1787387862.967397:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387862.967403:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967409:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c82ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967442:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967449:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967455:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967460:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387862.967463:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967469:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967477:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720300) 00010000:00010000:2.0:1787387862.967480:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387862.967482:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967488:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5c00/0x93d41aeaa23c81e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967523:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967551:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52acc expref: 21 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967559:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967594:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52acc expref: 21 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.967606:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52acc expref: 21 pid: 6840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387862.967620:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709727360:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387862.967716:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43742419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387862.972064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387862.972187:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690857216 00000100:00100000:3.0:1787387862.972198:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690857216 00010000:00010000:3.0:1787387862.972242:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52acc expref: 22 pid: 6840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387862.972303:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:3.0:1787387862.972313:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:2351:x1874211690857216:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387862.972327:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387862.972335:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52acc expref: 22 pid: 6840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972348:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52acc expref: 22 pid: 6840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972372:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720300) 00010000:00010000:3.0:1787387862.972377:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972386:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972394:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972414:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387862.972476:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:2351:x1874211690857216:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 163us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387862.972484:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00010000:00010000:3.0:1787387862.972545:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8206 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52acc expref: 21 pid: 6840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387862.972563:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709727360:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387862.972590:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972598:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972604:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972615:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972621:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972639:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972643:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387862.972648:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972655:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972663:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720300) 00010000:00010000:3.0:1787387862.972665:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387862.972669:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972675:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c82b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972697:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972715:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972720:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972723:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387862.972726:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972731:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972762:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4358720300) 00010000:00010000:3.0:1787387862.972765:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787387862.972768:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387862.972773:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387862.972957:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:11501:x1874211690856960:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 17532us (18120us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787387862.972966:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 186 00000020:00080000:3.0:1787387862.972969:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787387862.975856:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787387862.975867:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787387862.978337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000040:00080000:1.0:1787387862.979048:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787387862.979063:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787387862.979154:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690857472 00000100:00100000:1.0:1787387862.979175:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690857472 00000100:00100000:1.0:1787387862.979234:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:1.0:1787387862.979244:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d436567b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:11501:x1874211690857472:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787387862.980883:0:5811:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787387862.980999:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787387862.981068:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c82bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.981097:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c82bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.981111:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c82bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.981131:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c82bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.981139:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c82bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.981144:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c82bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387862.981298:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787387862.981419:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d436567b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:11501:x1874211690857472:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 2172us (3090us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787387862.981429:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000020:00080000:1.0:1787387862.981435:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787387862.983513:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387862.983692:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c82bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.983705:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f600 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387862.983710:0:11539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c82bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.983721:0:11539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c82bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.983851:0:11539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d4358720d00) 00010000:00010000:2.0:1787387862.983854:0:11539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787387862.983860:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c82bc lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.983866:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f600/0x93d41aeaa23c82bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387862.983890:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387862.983891:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387862.983894:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387863.389966:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387863.646180:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387863.646205:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709727488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387863.646281:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387863.646880:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709727488 00000100:00100000:1.0:1787387863.646889:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709727488 00000100:00100000:1.0:1787387863.646960:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787387863.646971:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709727488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387863.647007:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387863.647063:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709727488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387863.647070:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787387863.647118:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709727488:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787387863.647192:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387863.649996:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709727616:0@lo:400:kworker.0 00000100:00100000:2.0:1787387863.650084:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387863.650132:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709728128:0@lo:400:kworker.0 00000100:00100000:2.0:1787387863.650172:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387863.650199:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387863.650205:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709728000:0@lo:400:kworker.0 00000100:00100000:2.0:1787387863.650228:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387863.650258:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709728000 00000100:00100000:2.0:1787387863.650265:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709728000 00000100:00100000:2.0:1787387863.650309:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787387863.650317:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709728000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387863.650383:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709728000:12345-0@lo:400:kworker.0 Request processed in 65us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387863.650404:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787387863.650452:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709728000:0@lo:400:kworker.0 00000100:00100000:0.0:1787387863.650873:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709727744:0@lo:400:kworker.0 00000100:00100000:0.0:1787387863.650912:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387863.650946:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387863.650952:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709727872:0@lo:400:kworker.0 00000100:00100000:0.0:1787387863.650987:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387863.651357:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709728128 00000100:00100000:3.0:1787387863.651371:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709728128 00000100:00100000:3.0:1787387863.651426:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709727744 00000100:00100000:3.0:1787387863.651429:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709727744 00000100:00100000:3.0:1787387863.651442:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709727872 00000100:00100000:3.0:1787387863.651444:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709727872 00000100:00100000:3.0:1787387863.651459:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787387863.651468:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709728128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387863.651797:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709728128:12345-0@lo:400:kworker.0 Request processed in 329us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387863.651806:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787387863.651825:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787387863.651832:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709727744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387863.651866:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709727744:12345-0@lo:400:kworker.0 Request processed in 35us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387863.651872:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787387863.651884:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787387863.651890:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709727872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387863.651914:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709727872:12345-0@lo:400:kworker.0 Request processed in 25us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387863.651920:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787387863.652101:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709727616 00000100:00100000:1.0:1787387863.652107:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709727616 00000100:00100000:1.0:1787387863.652145:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787387863.652153:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709727616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387863.652212:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709727616:12345-0@lo:400:kworker.0 Request processed in 61us (2129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387863.652219:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:0.0:1787387863.652680:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387863.652720:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709727872:0@lo:400:kworker.0 00000100:00100000:0.0:1787387863.652733:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709727744:0@lo:400:kworker.0 00000100:00100000:2.0:1787387863.653799:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709727616:0@lo:400:kworker.0 00000100:00100000:2.0:1787387863.653818:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709728128:0@lo:400:kworker.0 00010000:00010000:2.0:1787387864.415270:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787387864.549424:0:12387:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387864.549435:0:12387:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787387864.549490:0:12387:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787387864.549496:0:12387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787387864.673344:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387864.673369:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709728256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387864.673443:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387864.673506:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709728256 00000100:00100000:3.0:1787387864.673514:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709728256 00000100:00100000:3.0:1787387864.673578:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787387864.673587:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709728256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787387864.673643:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387864.673684:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709728256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387864.673692:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787387864.673713:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387864.673767:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709728256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387864.815093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387864.815135:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690857728 00000100:00100000:3.0:1787387864.815145:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690857728 00000100:00100000:3.0:1787387864.815206:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:3.0:1787387864.815217:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:11519:x1874211690857728:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387864.815243:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387864.815267:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a400/0x93d41aeaa23c82c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b04 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.815674:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.815689:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.815703:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387864.815716:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787387864.816709:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a400/0x93d41aeaa23c82c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b04 expref: 25 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.816766:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b04 expref: 24 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.816775:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:3.0:1787387864.816777:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787387864.816781:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a200, rc 0) 00000100:00080000:2.0:1787387864.817370:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387864.820533:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:11519:x1874211690857728:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1645us (1776us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787387864.820547:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:0.0:1787387864.825948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387864.825993:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690857856 00000100:00100000:0.0:1787387864.826003:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690857856 00000100:00100000:0.0:1787387864.826189:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 188 00000100:00100000:0.0:1787387864.826200:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:11519:x1874211690857856:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1787387864.826282:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c82d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.826300:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c82d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.826312:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c82d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.826389:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c82df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.826398:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c82df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.826405:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c82df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.827783:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c82e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.827807:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c82e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.827817:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c82e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787387864.828009:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c82e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828024:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c82d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828032:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c82d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828112:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c82d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828118:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387864.828121:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c82d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828129:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c82d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828141:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:0.0:1787387864.828145:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387864.828149:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c82d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828154:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c82d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828171:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c82df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828176:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c82df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828182:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c82df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828187:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387864.828190:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c82df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828195:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c82df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828202:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c46600) 00010000:00010000:0.0:1787387864.828204:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387864.828207:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c82df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828213:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c82df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828226:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c82e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828231:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c82e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828236:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c82e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828245:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387864.828248:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c82e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828253:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c82e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828260:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c46400) 00010000:00010000:0.0:1787387864.828262:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387864.828265:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c82e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.828270:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c82e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387864.829188:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:11519:x1874211690857856:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 2980us (3241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387864.829201:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 188 00000100:00100000:2.0:1787387864.909470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387864.911619:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690858112 00000100:00100000:3.0:1787387864.911637:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690858112 00000100:00100000:3.0:1787387864.911719:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 189 00000100:00100000:3.0:1787387864.911731:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:11522:x1874211690858112:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387864.911801:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387864.911826:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a400/0x93d41aeaa23c82ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b0b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.911910:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c82f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.911927:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c82f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.911940:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c82f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.911956:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c82fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.911978:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c82fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.911986:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c82fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912343:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912352:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912360:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387864.912370:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787387864.912470:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c82f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912477:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c82f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912484:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c82f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912503:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387864.912507:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c82f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912515:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c82f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912538:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:3.0:1787387864.912540:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387864.912545:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c82f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912552:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c82f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912566:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c82fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912573:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c82fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912579:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c82fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912584:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387864.912597:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c82fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912604:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c82fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912613:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c2d800) 00010000:00010000:3.0:1787387864.912615:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387864.912618:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c82fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912624:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c82fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912680:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a400/0x93d41aeaa23c82ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b0b expref: 27 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912694:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b0b expref: 26 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387864.912702:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:3.0:1787387864.912705:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387864.912707:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460aa00, rc 0) 00000100:00100000:3.0:1787387864.912816:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:11522:x1874211690858112:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1087us (3360us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787387864.912826:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 189 00000100:00100000:3.0:1787387864.919936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387864.925298:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690858240 00000100:00100000:0.0:1787387864.925314:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690858240 00000100:00100000:0.0:1787387864.925381:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 190 00000100:00100000:0.0:1787387864.925393:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:11522:x1874211690858240:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1787387864.925495:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c8310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.925512:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c8310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.925524:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c8310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.925569:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c8310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.925577:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c8310 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.925584:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c8310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.925601:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387864.925605:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c8310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.925612:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c8310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.925625:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:0.0:1787387864.925629:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787387864.925634:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c8310 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387864.925640:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c8310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387864.925732:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:11522:x1874211690858240:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 340us (5806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387864.925988:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 190 00000100:00100000:1.0:1787387864.934977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387864.935151:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690858496 00000100:00100000:2.0:1787387864.935163:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690858496 00000100:00100000:2.0:1787387864.935229:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:2.0:1787387864.935239:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:11522:x1874211690858496:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1787387864.935715:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:11522:x1874211690858496:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 475us (747us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787387864.935725:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:2.0:1787387865.007510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387865.007665:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690858752 00000100:00100000:3.0:1787387865.007675:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690858752 00000100:00100000:3.0:1787387865.007767:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:3.0:1787387865.007778:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:11047:x1874211690858752:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1787387865.007805:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387865.007829:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a400/0x93d41aeaa23c8317 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b12 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.007952:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.007969:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8302 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b0b expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.007999:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.008040:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b0b expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.008054:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b0b expref: 28 pid: 5809 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387865.008068:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709728384:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387865.008155:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43417a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787387865.013013:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709728384:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387865.013043:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387865.018675:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387865.018939:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690858880 00000100:00100000:3.0:1787387865.018950:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690858880 00010000:00010000:3.0:1787387865.018993:0:11042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b0b expref: 29 pid: 5809 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387865.019039:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:3.0:1787387865.019049:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:2351:x1874211690858880:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387865.019063:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387865.019070:0:11042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b0b expref: 29 pid: 5809 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.019084:0:11042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b0b expref: 29 pid: 5809 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.019107:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b0b expref: 29 pid: 5809 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.019137:0:11042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:3.0:1787387865.019147:0:11042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.019157:0:11042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.019164:0:11042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.019238:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387865.019316:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:2351:x1874211690858880:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 259us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387865.019324:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00010000:00010000:2.0:1787387865.022874:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.022909:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387865.022934:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787387865.023298:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a400/0x93d41aeaa23c8317 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b12 expref: 29 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.023446:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b12 expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.023456:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:2.0:1787387865.023459:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787387865.023463:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a800, rc 0) 00000100:00100000:2.0:1787387865.023612:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:11047:x1874211690858752:12345-192.168.204.59@tcp:101:bash.0 Request processed in 15835us (16112us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787387865.023621:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:2.0:1787387865.027795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.027918:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690859136 00000100:00100000:0.0:1787387865.027929:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690859136 00000100:00100000:0.0:1787387865.027990:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 192 00000100:00100000:0.0:1787387865.028012:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:11047:x1874211690859136:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:0.0:1787387865.028322:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c832c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.028350:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c832c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.028361:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c832c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387865.028409:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787387865.028432:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d861eba1 reply state 00000000a7e5e7b0 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c832c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387865.028441:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787387865.028480:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787387865.028604:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+32:11047:x1874211690859136:12345-192.168.204.59@tcp:36:bash.0 Request processed in 592us (863us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787387865.028611:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 192 00000020:00080000:0.0:1787387865.028616:0:6840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787387865.032376:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c832c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.032394:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c832c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.032401:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c832c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.032406:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387865.032412:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c832c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.032420:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c832c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.032437:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:1.0:1787387865.032440:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387865.032445:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c832c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.032451:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c832c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387865.034178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.034611:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690859264 00000100:00100000:0.0:1787387865.034621:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690859264 00000100:00100000:0.0:1787387865.034678:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 193 00000100:00100000:0.0:1787387865.034686:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+31:11047:x1874211690859264:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1787387865.034708:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387865.034726:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8333 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.034820:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8333 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b19 expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.034862:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8333 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b19 expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.034883:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:0.0:1787387865.034886:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787387865.034890:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71000, rc 0) 00000100:00100000:0.0:1787387865.034941:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+32:11047:x1874211690859264:12345-192.168.204.59@tcp:101:bash.0 Request processed in 256us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387865.034948:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 193 00000100:00100000:3.0:1787387865.037387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.037725:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690859392 00000100:00100000:2.0:1787387865.037735:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690859392 00000100:00100000:2.0:1787387865.037829:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:2.0:1787387865.037839:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:11047:x1874211690859392:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1787387865.037980:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387865.038004:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c833a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b20 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787387865.038031:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a895fd5, atime: 0x6a895fd3, ctime: 0x6a895fd5, blocks: 0xb 00010000:00010000:2.0:1787387865.038126:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:2.0:1787387865.038131:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387865.038139:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c833a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b20 expref: 8 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.038155:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c833a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b20 expref: 8 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.038169:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fda00, rc 0) 00000100:00100000:2.0:1787387865.038343:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:11047:x1874211690859392:12345-192.168.204.59@tcp:101:bash.0 Request processed in 504us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387865.038350:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00080000:3.0:1787387865.038514:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387865.044337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.044517:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690859520 00000100:00100000:0.0:1787387865.044529:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690859520 00002000:00010000:0.0:1787387865.044569:0:6609:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787387865.044574:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4343525500 with x1874211690859520 ext(0->18446744073709551615) 00002000:00010000:0.0:1787387865.044596:0:6609:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4343525500. 00000100:00100000:0.0:1787387865.044627:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:0.0:1787387865.044637:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4343525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690859520:12345-192.168.204.59@tcp:10:bash.0 00002000:00010000:0.0:1787387865.044963:0:6609:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787387865.044967:0:6609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787387861 -> 1787387865 00002000:00010000:0.0:1787387865.044970:0:6609:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787387859 -> 1787387859 00002000:00010000:0.0:1787387865.044972:0:6609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787387861 -> 1787387865 00002000:00010000:0.0:1787387865.044974:0:6609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787387865.045041:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4343525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2350:x1874211690859520:12345-192.168.204.59@tcp:10:bash.0 Request processed in 405us (712us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787387865.045049:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00002000:00010000:0.0:1787387865.045052:0:6609:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787387865.045067:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4343525500 with x1874211690859520 ext(0->18446744073709551615) 00002000:00010000:0.0:1787387865.045072:0:6609:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4343525500. 00000100:00100000:1.0:1787387865.156663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.156765:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690859648 00000100:00100000:0.0:1787387865.156778:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690859648 00000100:00100000:0.0:1787387865.156841:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 194 00000100:00100000:0.0:1787387865.156861:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+32:11536:x1874211690859648:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1787387865.156939:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8341 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.156957:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.156968:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.156981:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.156987:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.156992:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157289:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c834f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157299:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c834f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157306:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c834f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787387865.157602:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c834f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157615:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157621:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8341 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157627:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157633:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387865.157636:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157644:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8341 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157655:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:0.0:1787387865.157657:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387865.157662:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8341 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157667:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8341 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157679:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157685:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8348 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157698:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157702:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387865.157705:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157711:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8348 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157719:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c46400) 00010000:00010000:0.0:1787387865.157722:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387865.157725:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8348 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157730:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157803:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c834f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157810:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c834f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157816:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c834f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157821:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387865.157824:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c834f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157839:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c834f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157955:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:0.0:1787387865.157959:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387865.157963:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c834f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.157970:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c834f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387865.158050:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+32:11536:x1874211690859648:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 1197us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387865.158059:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 194 00000100:00100000:3.0:1787387865.228821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.228920:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690859904 00000100:00100000:0.0:1787387865.228932:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690859904 00000100:00100000:0.0:1787387865.228996:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 195 00000100:00100000:0.0:1787387865.229007:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+32:11539:x1874211690859904:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387865.229027:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387865.229049:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c8356 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b27 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229126:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c835d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229142:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c835d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229153:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c835d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229195:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229203:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229211:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229577:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c836b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229596:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c836b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229604:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c836b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387865.229615:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787387865.229713:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c835d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229721:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c835d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229728:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c835d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229734:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387865.229790:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c835d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229808:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c835d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229821:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:0.0:1787387865.229824:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387865.229829:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c835d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229835:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c835d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229850:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229856:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8364 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229862:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229867:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387865.229870:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229876:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8364 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229883:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c46400) 00010000:00010000:0.0:1787387865.229886:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387865.229888:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8364 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229905:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229950:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70a00/0x93d41aeaa23c8356 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b27 expref: 35 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229963:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c836b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b27 expref: 34 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.229970:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:0.0:1787387865.229972:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787387865.229975:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70c00, rc 0) 00000100:00100000:0.0:1787387865.230038:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:11539:x1874211690859904:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1032us (1227us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787387865.230046:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 195 00000100:00100000:3.0:1787387865.238708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387865.238873:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690860032 00000100:00100000:1.0:1787387865.238885:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690860032 00000100:00100000:1.0:1787387865.238967:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 196 00000100:00100000:1.0:1787387865.238978:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:11539:x1874211690860032:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1787387865.239055:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.239073:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b12 expref: 34 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.239084:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.239122:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b12 expref: 34 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.239136:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b12 expref: 34 pid: 5809 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387865.239152:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374489180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709728512:192.168.204.59@tcp:104: 00000100:00100000:1.0:1787387865.239475:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43465979c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387865.246698:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374489180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709728512:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387865.246730:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387865.247185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.250031:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690860288 00000100:00100000:2.0:1787387865.250047:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690860288 00000100:00100000:2.0:1787387865.250178:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:2.0:1787387865.250190:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:9221:x1874211690860288:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787387865.250596:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:9221:x1874211690860288:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 408us (3411us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787387865.250605:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:3.0:1787387865.254197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.256045:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690860416 00000100:00100000:0.0:1787387865.256058:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690860416 00010000:00010000:0.0:1787387865.256105:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b12 expref: 36 pid: 5809 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387865.256156:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:0.0:1787387865.256166:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a082a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:2351:x1874211690860416:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387865.256209:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387865.256217:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b12 expref: 36 pid: 5809 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256233:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b12 expref: 36 pid: 5809 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256258:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a800/0x93d41aeaa23c831e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b12 expref: 36 pid: 5809 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256277:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:0.0:1787387865.256283:0:8324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256293:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256300:0:8324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256330:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387865.256397:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a082a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:2351:x1874211690860416:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 231us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387865.256405:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 73 00010000:00010000:0.0:1787387865.256435:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256443:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256484:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256492:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256499:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256504:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387865.256508:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256515:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256524:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:0.0:1787387865.256527:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787387865.256530:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.256536:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8379 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387865.256576:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:11539:x1874211690860032:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 17600us (17879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387865.256597:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 196 00000100:00100000:3.0:1787387865.259326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387865.259788:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690860672 00000100:00100000:1.0:1787387865.259797:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690860672 00000100:00100000:1.0:1787387865.259854:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:1.0:1787387865.259863:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+34:11539:x1874211690860672:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1787387865.260089:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:11539:x1874211690860672:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 227us (771us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787387865.260097:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:0.0:1787387865.376611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387865.376765:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690860928 00000100:00100000:3.0:1787387865.376776:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690860928 00000100:00100000:3.0:1787387865.376856:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 197 00000100:00100000:3.0:1787387865.376866:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+35:11550:x1874211690860928:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:3.0:1787387865.376893:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387865.376916:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8380 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b2e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377012:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c8387 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377039:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c8387 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377052:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c8387 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377067:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c838e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377074:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c838e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377080:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c838e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377420:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377431:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377437:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387865.377448:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787387865.377539:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c8387 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377546:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c8387 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377558:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c8387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377564:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387865.377568:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c8387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377576:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c8387 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377599:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:3.0:1787387865.377602:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387865.377606:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c8387 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377612:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c8387 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377637:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c838e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377643:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c838e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377648:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c838e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377654:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ac00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387865.377657:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c838e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377673:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c838e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377682:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c2d800) 00010000:00010000:3.0:1787387865.377684:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387865.377687:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c838e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377693:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c838e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377735:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8380 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b2e expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377805:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b2e expref: 37 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.377812:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:3.0:1787387865.377814:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387865.377817:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460ba00, rc 0) 00000100:00100000:3.0:1787387865.377891:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+37:11550:x1874211690860928:12345-192.168.204.59@tcp:101:cat.0 Request processed in 1025us (1288us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787387865.377899:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 197 00000100:00100000:3.0:1787387865.389854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387865.389926:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690861184 00000100:00100000:1.0:1787387865.389937:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690861184 00000100:00100000:1.0:1787387865.390000:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1787387865.390010:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+37:11550:x1874211690861184:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:1.0:1787387865.390262:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+38:11550:x1874211690861184:12345-192.168.204.59@tcp:35:cat.0 Request processed in 252us (417us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787387865.390270:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1787387865.425296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.425404:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690861440 00000100:00100000:0.0:1787387865.425415:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690861440 00000100:00100000:0.0:1787387865.425499:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 198 00000100:00100000:0.0:1787387865.425509:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+38:11551:x1874211690861440:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:0.0:1787387865.425568:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787387865.425607:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ba00/0x93d41aeaa23c8395 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b2e expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.425645:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70c00/0x93d41aeaa23c836b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b27 expref: 37 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.425660:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71000/0x93d41aeaa23c8333 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b19 expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.425671:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:0.0:1787387865.425685:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387865.425709:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c83a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.425724:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c83a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.425734:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c83a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.425802:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c83aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.425809:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c83aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.425816:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c83aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.426141:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c83b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.426150:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c83b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.426158:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c83b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787387865.427161:0:6840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1787387865.427173:0:6840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369876433175ns, next at 370876430633ns, rc = 0 00010000:00010000:0.0:1787387865.427237:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c83b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427248:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c83b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427257:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c83b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427264:0:6840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c83b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427269:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c83b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427275:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c83b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427341:0:6840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787387865.427362:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c83b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427375:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c83b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427380:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c83b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427386:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387865.427391:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c83b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427399:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c83b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427411:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c46600) 00010000:00010000:0.0:1787387865.427414:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787387865.427418:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c83b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427423:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c83b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427442:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c83a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427448:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c83a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427454:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c83a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427459:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387865.427468:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c83a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427475:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c83a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427494:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:0.0:1787387865.427496:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387865.427499:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c83a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.427504:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c83a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787387865.427515:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000017bd8f4 reply state 000000005534a8a7 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c83aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387865.427523:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387865.427618:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+37:11551:x1874211690861440:12345-192.168.204.59@tcp:36:rm.0 Request processed in 2106us (2327us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787387865.427627:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 198 00010000:00010000:3.0:1787387865.430929:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c83aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.430949:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c83aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.430971:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c83aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.430977:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387865.430982:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c83aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.430990:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c83aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.431008:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c46400) 00010000:00010000:3.0:1787387865.431011:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387865.431016:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c83aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.431032:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c83aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.432602:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387865.432615:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c83b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.432686:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71e00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387865.432690:0:11539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c83b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.432717:0:11539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c83b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.432731:0:11539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d4343c46600) 00010000:00010000:2.0:1787387865.432734:0:11539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787387865.433171:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c83b8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.433180:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c83b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.433207:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387865.433210:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387865.433212:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387865.438040:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387865.497016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.497121:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690861696 00000100:00100000:2.0:1787387865.497132:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690861696 00000100:00100000:2.0:1787387865.497192:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 199 00000100:00100000:2.0:1787387865.497204:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+36:11557:x1874211690861696:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1787387865.497229:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387865.497250:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c83bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b35 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.497379:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.497395:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.497407:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.497438:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.497445:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.497451:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787387865.498056:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787387865.498223:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c83d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.498234:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c83d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.498242:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c83d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.498275:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.498282:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.498288:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.498294:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387865.498298:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.498316:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.498329:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:2.0:1787387865.498332:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387865.498337:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.498343:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787387865.498359:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029bbb042 reply state 000000004abd43d8 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387865.498368:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787387865.498395:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c83bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b35 expref: 39 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.498410:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c83d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b35 expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.498417:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:2.0:1787387865.498419:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787387865.498421:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fd000, rc 0) 00000100:00100000:2.0:1787387865.498490:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+39:11557:x1874211690861696:12345-192.168.204.59@tcp:101:bash.0 Request processed in 1289us (1483us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787387865.498498:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 199 00010000:00010000:1.0:1787387865.503232:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.503251:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.503258:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.503265:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387865.503270:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.503278:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.503296:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d436f2f6a00) 00010000:00010000:1.0:1787387865.503300:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387865.503304:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.503329:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387865.504037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.504715:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690861824 00000100:00100000:2.0:1787387865.505251:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690861824 00000100:00080000:3.0:1787387865.505902:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387865.505996:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:2.0:1787387865.506011:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690861824:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1787387865.506101:0:11067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387865.506129:0:11067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cb6d761/0x93d41aeaa23c83e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b3c expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787387865.506160:0:11067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787387865.506181:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:2.0:1787387865.506185:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387865.506195:0:11067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cb6d761/0x93d41aeaa23c83e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b3c expref: 6 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.506213:0:11067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004cb6d761/0x93d41aeaa23c83e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b3c expref: 6 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.506227:0:11067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fd600, rc 0) 00000100:00100000:2.0:1787387865.511289:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690861824:12345-192.168.204.59@tcp:101:bash.0 Request processed in 5271us (7244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387865.511302:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:0.0:1787387865.514531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387865.515147:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690861952 00000100:00100000:3.0:1787387865.515157:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690861952 00000100:00100000:3.0:1787387865.515222:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 303 00000100:00100000:3.0:1787387865.515233:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2351:x1874211690861952:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387865.515321:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2351:x1874211690861952:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 90us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387865.515336:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 303 00000100:00100000:0.0:1787387865.516690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.516730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.516824:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690862080 00000100:00100000:2.0:1787387865.516833:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690862080 00000100:00100000:2.0:1787387865.516901:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:2.0:1787387865.516910:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2351:x1874211690862080:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387865.516967:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2351:x1874211690862080:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 59us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387865.516988:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00080000:0.0:1787387865.517169:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387865.517717:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690862208 00000100:00100000:3.0:1787387865.517723:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690862208 00000100:00100000:3.0:1787387865.517792:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:3.0:1787387865.517799:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:11557:x1874211690862208:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1787387865.517813:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387865.517830:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b43 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.517858:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004cb6d761/0x93d41aeaa23c83e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b3c expref: 7 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.517868:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387865.517872:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387865.517877:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.517922:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004cb6d761/0x93d41aeaa23c83e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b3c expref: 7 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.517935:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004cb6d761/0x93d41aeaa23c83e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b3c expref: 7 pid: 11067 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387865.517948:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6605:1874211709728640:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387865.518030:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43417a4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787387865.524196:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6605:1874211709728640:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387865.524248:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.524302:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460aa00, rc 0) 00000100:00100000:3.0:1787387865.524385:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:11557:x1874211690862208:12345-192.168.204.59@tcp:101:bash.0 Request processed in 6584us (7651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387865.524394:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:1.0:1787387865.536968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.537064:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690862336 00000100:00100000:2.0:1787387865.537074:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690862336 00010000:00010000:2.0:1787387865.537116:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004cb6d761/0x93d41aeaa23c83e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b3c expref: 7 pid: 11067 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387865.537163:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:2.0:1787387865.537181:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690862336:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387865.537196:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387865.537220:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004cb6d761/0x93d41aeaa23c83e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b3c expref: 7 pid: 11067 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.537234:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004cb6d761/0x93d41aeaa23c83e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b3c expref: 7 pid: 11067 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.537259:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cb6d761/0x93d41aeaa23c83e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b3c expref: 7 pid: 11067 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.537277:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387865.537281:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387865.537288:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.537298:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.537369:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387865.537383:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5792:1874211709728768:192.168.204.59@tcp:105: 00000100:00100000:2.0:1787387865.537965:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387865.540859:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5792:1874211709728768:192.168.204.59@tcp:105: 00010000:00010000:2.0:1787387865.540888:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387865.540952:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690862336:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 3773us (3996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387865.540964:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:3.0:1787387865.541393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.541825:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690862592 00000100:00100000:2.0:1787387865.541834:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690862592 00000100:00100000:2.0:1787387865.541882:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:2.0:1787387865.541891:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+38:11557:x1874211690862592:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:2.0:1787387865.542253:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+39:11557:x1874211690862592:12345-192.168.204.59@tcp:35:bash.0 Request processed in 361us (859us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787387865.542261:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:3.0:1787387865.779546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.779692:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690862720 00000100:00100000:2.0:1787387865.779704:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690862720 00000100:00100000:2.0:1787387865.779798:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 200 00000100:00100000:2.0:1787387865.779809:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+39:11573:x1874211690862720:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1787387865.779835:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387865.779862:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c83f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b4a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.779957:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.779973:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.779986:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387865.780053:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787387865.780058:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787387865.780083:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.780110:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c83f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b4a expref: 41 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.780129:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b4a expref: 40 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.780138:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:2.0:1787387865.780140:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787387865.780144:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fc600, rc 0) 00000100:00100000:2.0:1787387865.780206:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+40:11573:x1874211690862720:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 399us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387865.780214:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 200 00000100:00100000:1.0:1787387865.786523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.786807:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690862976 00000100:00100000:2.0:1787387865.786821:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690862976 00000100:00100000:2.0:1787387865.786906:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 201 00000100:00100000:2.0:1787387865.786917:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+40:11573:x1874211690862976:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1787387865.786941:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387865.786963:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b51 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.787078:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.787095:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.787110:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387865.787140:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787387865.787300:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c83fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b51 expref: 43 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.787321:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b51 expref: 42 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.787330:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:2.0:1787387865.787334:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787387865.787338:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90800, rc 0) 00000100:00100000:2.0:1787387865.787417:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+42:11573:x1874211690862976:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 501us (905us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787387865.787425:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 201 00000100:00100000:0.0:1787387865.793540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.793593:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.793778:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690863360 00000100:00100000:2.0:1787387865.793803:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690863360 00000100:00100000:2.0:1787387865.793857:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 202 00000100:00100000:2.0:1787387865.793867:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+42:11573:x1874211690863360:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1787387865.793896:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387865.793918:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c8413 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b58 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.794023:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c841a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.794037:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c841a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.794050:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c841a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387865.794064:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787387865.794196:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c8413 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b58 expref: 45 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.794216:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c841a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b58 expref: 44 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.794226:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:2.0:1787387865.794229:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787387865.794232:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90600, rc 0) 00000100:00100000:2.0:1787387865.794297:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+44:11573:x1874211690863360:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 431us (702us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787387865.794306:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 202 00000100:00100000:3.0:1787387865.795437:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690863104 00000100:00100000:3.0:1787387865.795448:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690863104 00000100:00100000:3.0:1787387865.795594:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:3.0:1787387865.795604:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+44:2351:x1874211690863104:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387865.795617:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387865.795638:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b51 expref: 44 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.795657:0:11042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:3.0:1787387865.795660:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387865.795702:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+43:2351:x1874211690863104:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 100us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387865.795710:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:3.0:1787387865.807360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.807833:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690863488 00000100:00100000:0.0:1787387865.807844:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690863488 00000100:00100000:0.0:1787387865.807956:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:0.0:1787387865.807967:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+6:2350:x1874211690863488:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:0.0:1787387865.808035:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.808058:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.808066:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787387865.808070:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787387865.808075:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.808111:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.808124:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 6 pid: 6605 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387865.808140:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a278a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1874211709728896:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387865.810514:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda900 going to sleep for 11 seconds 00000100:00100000:1.0:1787387865.816909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.817207:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a278a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1874211709728896:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387865.817211:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690863616 00000100:00100000:2.0:1787387865.817218:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690863616 00010000:00010000:0.0:1787387865.817236:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1787387865.817265:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d4345d05880 x1874211690863616/t0(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:121/0 lens 504/0 e 0 to 0 dl 1787387876 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787387865.817275:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4345d05880 with x1874211690863616 ext(0->8) 00010000:00010000:2.0:1787387865.817282:0:6611:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 7 pid: 6605 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.817294:0:6611:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 7 pid: 6605 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787387865.817301:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4345d05880 00000100:00100000:2.0:1787387865.817333:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:2.0:1787387865.817344:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2351:x1874211690863616:12345-192.168.204.59@tcp:4:lfs.0 00000100:00100000:2.0:1787387865.817888:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2351:x1874211690863616:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 541us (985us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787387865.817897:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00002000:00100000:2.0:1787387865.817905:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d4345d05880 x1874211690863616/t4294967308(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:121/0 lens 504/448 e 0 to 0 dl 1787387876 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787387865.817914:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4345d05880 with x1874211690863616 ext(0->8) 00010000:00010000:2.0:1787387865.817920:0:6611:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 9 pid: 6605 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.817931:0:6611:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 9 pid: 6605 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787387865.817947:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4345d05880 00000100:00100000:1.0:1787387865.823896:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387865.823989:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690863744 00000100:00100000:3.0:1787387865.823999:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690863744 00010000:00010000:3.0:1787387865.824039:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 9 pid: 6605 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387865.824110:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:3.0:1787387865.824119:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2353:x1874211690863744:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387865.824146:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787387865.824168:0:5794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787387865.824170:0:5794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787387865 00002000:00010000:3.0:1787387865.824172:0:5794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787387865 00002000:00010000:3.0:1787387865.824174:0:5794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787387865 00010000:00010000:3.0:1787387865.824180:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 9 pid: 6605 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.824195:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 9 pid: 6605 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.824222:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c83e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b43 expref: 9 pid: 6605 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.824242:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787387865.824246:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787387865.824254:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.824264:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.824307:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387865.824383:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2353:x1874211690863744:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 264us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387865.824391:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00010000:00010000:1.0:1787387865.824561:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.824583:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.824609:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.824616:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.824623:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.824642:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71a00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387865.824647:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.824669:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.824680:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.824688:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048d4207d/0x93d41aeaa23c8428 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387865.824809:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690863488:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 16844us (17458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387865.824818:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:3.0:1787387865.829001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.837592:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690864000 00000100:00100000:2.0:1787387865.837611:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690864000 00000100:00100000:2.0:1787387865.837865:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:2.0:1787387865.837878:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4365679050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+43:11573:x1874211690864000:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:2.0:1787387865.837966:0:5811:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c841a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b58 expref: 43 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787387865.838251:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787387865.838304:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787387865.838639:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787387865.840611:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.840640:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c83d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b35 expref: 47 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.840658:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.840707:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c83d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b35 expref: 47 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.840725:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c83d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b35 expref: 47 pid: 5809 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387865.840757:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2db480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5811:1874211709729024:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387865.840866:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387865.843981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387865.844056:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690864128 00000100:00100000:3.0:1787387865.844066:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690864128 00010000:00010000:3.0:1787387865.844106:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c83d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b35 expref: 48 pid: 5809 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387865.844154:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:3.0:1787387865.844164:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+48:2350:x1874211690864128:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387865.844182:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387865.844188:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c83d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b35 expref: 48 pid: 5809 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.844202:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c83d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b35 expref: 48 pid: 5809 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.844224:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:3.0:1787387865.844229:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.844238:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.844245:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387865.844263:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387865.844340:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+48:2350:x1874211690864128:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 176us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387865.844348:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00010000:00010000:1.0:1787387865.844628:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c83d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b35 expref: 47 pid: 5809 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387865.844644:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2db480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5811:1874211709729024:192.168.204.59@tcp:104: 00010000:00010000:1.0:1787387865.844673:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.844682:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387865.844687:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787387865.844987:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787387865.845202:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787387865.845473:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345d06300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1874211709729152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787387865.845526:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387865.845603:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4346597cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387865.850505:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709729152 00000100:00100000:0.0:1787387865.850521:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709729152 00000100:00080000:3.0:1787387865.850852:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387865.854398:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787387865.854447:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5811:x1874211709729152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787387865.854641:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5811:x1874211709729152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 205us (9113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387865.854660:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387865.854825:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345d06300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1874211709729152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787387865.855340:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787387865.855421:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2d8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1874211709729280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787387865.855466:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387865.865707:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43465979c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387865.873294:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709729280 00000100:00100000:1.0:1787387865.873314:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709729280 00000100:00100000:1.0:1787387865.873393:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787387865.873407:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5811:x1874211709729280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787387865.874136:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5811:x1874211709729280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 729us (18666us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787387865.874147:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387865.874261:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2d8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1874211709729280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787387865.874337:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787387865.874387:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.874397:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.874403:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.874409:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387865.874414:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.874421:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.874438:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:2.0:1787387865.874441:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787387865.874446:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387865.874472:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c842f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787387865.874698:0:5811:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787387865.874884:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787387865.874895:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370324155781ns, next at 371324154122ns, rc = 0 00000001:00080000:2.0:1787387865.875289:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787387865.875339:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d436f2f6000) 00010000:00010000:2.0:1787387865.875343:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787387865.875350:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c841a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b58 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387865.875483:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4365679050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+50:11573:x1874211690864000:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 37607us (46494us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787387865.875494:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000020:00080000:2.0:1787387865.875499:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787387865.883861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387865.883977:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690864256 00000100:00100000:0.0:1787387865.883988:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690864256 00000100:00100000:0.0:1787387865.884083:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 203 00000100:00100000:0.0:1787387865.884095:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+50:11573:x1874211690864256:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387865.884120:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387865.884144:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c8436 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.884216:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c8436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b5f expref: 51 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.884232:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c8436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b5f expref: 51 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387865.884251:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:0.0:1787387865.884254:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787387865.884257:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70800, rc 0) 00000100:00100000:0.0:1787387865.884322:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+51:11573:x1874211690864256:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 230us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387865.884329:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 203 00000100:00100000:3.0:1787387865.886867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387865.886962:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690864512 00000100:00100000:2.0:1787387865.886975:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690864512 00000100:00100000:2.0:1787387865.887047:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:2.0:1787387865.887059:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+51:11573:x1874211690864512:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1787387865.887330:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:11573:x1874211690864512:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 272us (471us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787387865.887338:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:3.0:1787387866.015715:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387866.016403:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690864640 00000100:00100000:2.0:1787387866.016417:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690864640 00000100:00100000:2.0:1787387866.016507:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 204 00000100:00100000:2.0:1787387866.016519:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:11583:x1874211690864640:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:2.0:1787387866.016629:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c843d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016648:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c843d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016659:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c843d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016674:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016682:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016689:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016845:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c844b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016855:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c844b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016863:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c844b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787387866.016911:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c844b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016924:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c843d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016943:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c843d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016950:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c843d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016957:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387866.016962:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c843d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016969:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c843d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016981:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:2.0:1787387866.016985:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387866.016990:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c843d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.016997:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c843d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017025:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017032:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8444 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017038:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017043:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387866.017053:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017060:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8444 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017069:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d436f2f6000) 00010000:00010000:2.0:1787387866.017072:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387866.017075:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8444 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017081:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017098:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c844b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017105:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c844b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017111:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c844b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017116:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387866.017119:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c844b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017124:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c844b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017132:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387866.017135:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387866.017144:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c844b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.017150:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c844b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387866.017926:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:11583:x1874211690864640:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 1403us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387866.017943:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 204 00000100:00080000:3.0:1787387866.018449:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387866.068249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387866.068422:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690864896 00000100:00100000:1.0:1787387866.068433:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690864896 00000100:00100000:1.0:1787387866.068506:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 205 00000100:00100000:1.0:1787387866.068517:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+52:11586:x1874211690864896:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1787387866.068537:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387866.068557:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8452 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b66 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.068659:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8459 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.068675:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.068688:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.068703:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.068724:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.068731:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.068891:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8467 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.068899:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.068906:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387866.068915:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787387866.069008:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069015:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8459 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069022:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8459 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069028:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387866.069033:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8459 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069040:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8459 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069064:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:1.0:1787387866.069067:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387866.069072:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8459 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069079:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8459 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069092:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069098:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8460 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069104:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069109:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152fc00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387866.069112:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069119:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8460 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069126:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4358720b00) 00010000:00010000:1.0:1787387866.069128:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387866.069131:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8460 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069137:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069190:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e000/0x93d41aeaa23c8452 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b66 expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069204:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b66 expref: 54 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.069212:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:1.0:1787387866.069214:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787387866.069216:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f400, rc 0) 00000100:00100000:1.0:1787387866.069629:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:11586:x1874211690864896:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1112us (1388us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787387866.069637:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 205 00000100:00100000:1.0:1787387866.074248:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387866.074385:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690865024 00000100:00100000:2.0:1787387866.074396:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690865024 00000100:00100000:2.0:1787387866.074461:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 206 00000100:00100000:2.0:1787387866.074482:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:11586:x1874211690865024:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:2.0:1787387866.074561:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.074589:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.074602:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.074631:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.074638:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8475 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.074644:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.074649:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387866.074668:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.074675:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8475 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.074689:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387866.074693:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787387866.074698:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8475 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.074704:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387866.074830:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:11586:x1874211690865024:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 360us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387866.074838:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 206 00000100:00100000:3.0:1787387866.081964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387866.082070:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690865280 00000100:00100000:2.0:1787387866.082081:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690865280 00000100:00100000:2.0:1787387866.082135:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:2.0:1787387866.082144:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+54:11586:x1874211690865280:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1787387866.082404:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:11586:x1874211690865280:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 260us (450us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787387866.082412:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:3.0:1787387866.172798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387866.172943:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690865536 00000100:00100000:1.0:1787387866.172953:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690865536 00000100:00100000:1.0:1787387866.173018:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 207 00000100:00100000:1.0:1787387866.173029:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:11596:x1874211690865536:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1787387866.173056:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387866.173060:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787387866.173088:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c83f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b4a expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.173111:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:1.0:1787387866.173116:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787387866.173130:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c847c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b6d expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.173532:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.173547:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8467 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b66 expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.173555:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.173601:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b66 expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387866.173615:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8467 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b66 expref: 55 pid: 6840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387866.173629:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345d05180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709729408:192.168.204.59@tcp:104: 00000100:00100000:1.0:1787387866.173957:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4353624840 going to sleep for 11 seconds 00000100:00100000:1.0:1787387866.177260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387866.177614:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345d05180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709729408:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387866.177645:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387866.177928:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690865664 00000100:00100000:2.0:1787387866.177936:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690865664 00010000:00010000:2.0:1787387866.177973:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8467 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b66 expref: 56 pid: 6840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387866.178059:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:2.0:1787387866.178075:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+56:2350:x1874211690865664:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387866.178092:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387866.178099:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8467 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b66 expref: 56 pid: 6840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.178110:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b66 expref: 56 pid: 6840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.178131:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152f400/0x93d41aeaa23c8467 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b66 expref: 56 pid: 6840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.178146:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387866.178150:0:8324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.178159:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.178183:0:8324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.178212:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387866.178270:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:2350:x1874211690865664:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 196us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387866.178279:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 77 00010000:00010000:0.0:1787387866.179206:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.179219:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387866.179239:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787387866.179407:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c847c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b6d expref: 56 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.179425:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b6d expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.179434:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:0.0:1787387866.179436:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787387866.179439:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e800, rc 0) 00000100:00100000:0.0:1787387866.179505:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:11596:x1874211690865536:12345-192.168.204.59@tcp:101:bash.0 Request processed in 6478us (6717us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787387866.179514:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 207 00000100:00100000:1.0:1787387866.183911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387866.183994:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690865920 00000100:00100000:2.0:1787387866.184004:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690865920 00000100:00100000:2.0:1787387866.184157:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 208 00000100:00100000:2.0:1787387866.184167:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+55:11596:x1874211690865920:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:2.0:1787387866.184623:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8491 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.184642:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.184653:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787387866.184712:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787387866.184860:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085309a78 reply state 000000000d66d54e transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387866.184870:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787387866.184978:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+58:11596:x1874211690865920:12345-192.168.204.59@tcp:36:bash.0 Request processed in 811us (1075us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787387866.184987:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 208 00000020:00080000:2.0:1787387866.184993:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787387866.187714:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.187732:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.187755:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.187762:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387866.187787:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.187797:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8491 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.187818:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:0.0:1787387866.187821:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387866.187825:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8491 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.187831:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8491 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387866.188385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387866.188695:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690866048 00000100:00100000:0.0:1787387866.188704:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690866048 00000100:00100000:0.0:1787387866.188780:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 209 00000100:00100000:0.0:1787387866.188790:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:11596:x1874211690866048:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1787387866.188812:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387866.188830:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8498 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b74 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.188912:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.188925:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b6d expref: 58 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.188934:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.188978:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b6d expref: 58 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.188991:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b6d expref: 58 pid: 6840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387866.189005:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709729536:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387866.189385:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387866.193000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387866.193081:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690866176 00000100:00100000:3.0:1787387866.193090:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690866176 00010000:00010000:3.0:1787387866.193130:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b6d expref: 59 pid: 6840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387866.193189:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:3.0:1787387866.193199:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:2351:x1874211690866176:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387866.193213:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387866.193220:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b6d expref: 59 pid: 6840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.193233:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b6d expref: 59 pid: 6840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.193256:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:3.0:1787387866.193261:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.193283:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.193291:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.193311:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387866.193372:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:2351:x1874211690866176:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 174us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387866.193379:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 78 00010000:00010000:0.0:1787387866.195087:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8483 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b6d expref: 58 pid: 6840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387866.195111:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1874211709729536:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387866.195138:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.195148:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.195154:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387866.195363:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787387866.195367:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387866.195389:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.195425:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8498 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b74 expref: 58 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.195530:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b74 expref: 57 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.195542:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:0.0:1787387866.195546:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387866.195550:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70000, rc 0) 00000100:00100000:0.0:1787387866.195684:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:11596:x1874211690866048:12345-192.168.204.59@tcp:101:bash.0 Request processed in 6894us (7302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387866.195693:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 209 00000100:00100000:1.0:1787387866.200530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387866.200675:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690866432 00000100:00100000:2.0:1787387866.200685:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690866432 00000100:00100000:2.0:1787387866.200833:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:2.0:1787387866.200844:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+57:11596:x1874211690866432:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:2.0:1787387866.201071:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+58:11596:x1874211690866432:12345-192.168.204.59@tcp:35:bash.0 Request processed in 229us (613us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787387866.201078:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:3.0:1787387866.281308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387866.281532:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690866560 00000100:00100000:0.0:1787387866.281543:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690866560 00000100:00100000:0.0:1787387866.281616:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 210 00000100:00100000:0.0:1787387866.281628:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+58:11602:x1874211690866560:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387866.281656:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387866.281680:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c84a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b7b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.281797:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c84ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.281811:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c84ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.281822:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c84ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387866.281880:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787387866.281895:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387866.281917:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c84ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.281941:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c84a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b7b expref: 60 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.281959:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c84ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b7b expref: 59 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.281967:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:0.0:1787387866.281970:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787387866.281973:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70e00, rc 0) 00000100:00100000:0.0:1787387866.282026:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:11602:x1874211690866560:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 400us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387866.282033:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 210 00000100:00100000:1.0:1787387866.286469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387866.286554:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690866688 00000100:00100000:3.0:1787387866.286574:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690866688 00000100:00100000:3.0:1787387866.286669:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 211 00000100:00100000:3.0:1787387866.286680:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:11602:x1874211690866688:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387866.286703:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387866.286727:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c84b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b82 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.286838:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c84bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.286855:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c84bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.286868:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c84bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.286884:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c84c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.286912:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c84c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.286919:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c84c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287023:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c84c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287032:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c84c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287040:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c84c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387866.287080:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787387866.287084:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387866.287103:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c84c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287115:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c84c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287123:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c84bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287130:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c84bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287136:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c84bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287152:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460aa00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387866.287157:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c84bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287164:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c84bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287177:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:3.0:1787387866.287180:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387866.287185:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c84bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287191:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c84bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287206:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c84c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287211:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c84c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287218:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c84c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287223:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387866.287226:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c84c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287232:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c84c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287249:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d4343c2d800) 00010000:00010000:3.0:1787387866.287252:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387866.287254:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c84c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287260:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c84c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287291:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c84b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b82 expref: 61 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287303:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c84c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b82 expref: 60 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.287310:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:3.0:1787387866.287313:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787387866.287315:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a600, rc 0) 00000100:00100000:3.0:1787387866.287383:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:11602:x1874211690866688:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 705us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387866.287390:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 211 00000100:00100000:1.0:1787387866.291547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387866.291632:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387866.291702:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690867072 00000100:00100000:3.0:1787387866.291712:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690867072 00000100:00100000:3.0:1787387866.291817:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:3.0:1787387866.291828:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:2351:x1874211690867072:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387866.291844:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387866.291873:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c84c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b82 expref: 60 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387866.291913:0:11042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:3.0:1787387866.291918:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387866.291972:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:2351:x1874211690867072:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 146us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387866.291980:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1787387866.293372:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690866944 00000100:00100000:0.0:1787387866.293385:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690866944 00000100:00100000:0.0:1787387866.293584:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 212 00000100:00100000:0.0:1787387866.293595:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:11602:x1874211690866944:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387866.293615:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387866.293634:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c84d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b89 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.293771:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.293786:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b74 expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.293812:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.293844:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b74 expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.293856:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b74 expref: 60 pid: 5808 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387866.293869:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709729664:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387866.293948:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387866.297989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387866.298667:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709729664:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387866.298698:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387866.298896:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690867200 00000100:00100000:2.0:1787387866.298904:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690867200 00010000:00010000:2.0:1787387866.298946:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b74 expref: 61 pid: 5808 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387866.299007:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:2.0:1787387866.299119:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:2350:x1874211690867200:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387866.299136:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387866.299143:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b74 expref: 61 pid: 5808 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.299157:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b74 expref: 61 pid: 5808 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.299193:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c849f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b74 expref: 61 pid: 5808 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.299212:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387866.299217:0:8324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.299226:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.299234:0:8324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.299256:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387866.299322:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:2350:x1874211690867200:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 205us (1342us total) trans 0 rc 0/0 00010000:00010000:0.0:1787387866.299369:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.299377:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387866.299396:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787387866.299573:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c84d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b89 expref: 62 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.299589:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b89 expref: 61 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387866.299609:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:0.0:1787387866.299612:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787387866.299615:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71400, rc 0) 00000100:00100000:0.0:1787387866.299644:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:11602:x1874211690866944:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 6050us (8106us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787387866.299652:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 212 00000100:00100000:2.0:1787387866.302260:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:1.0:1787387866.302896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387866.302957:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690867456 00000100:00100000:2.0:1787387866.302976:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690867456 00000100:00100000:2.0:1787387866.303032:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:2.0:1787387866.303042:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:11602:x1874211690867456:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:2.0:1787387866.303055:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387866.303078:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70800/0x93d41aeaa23c8436 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b5f expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.303095:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387866.303099:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387866.303149:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:11602:x1874211690867456:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 109us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387866.303155:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:0.0:1787387866.305502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387866.305629:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690867584 00000100:00100000:2.0:1787387866.305638:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690867584 00000100:00100000:2.0:1787387866.305695:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 213 00000100:00100000:2.0:1787387866.305705:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:11602:x1874211690867584:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:2.0:1787387866.305838:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.305855:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.305867:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787387866.306074:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787387866.306167:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:11602:x1874211690867584:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 463us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387866.306175:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 213 00000100:00100000:1.0:1787387866.308667:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387866.308812:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690867712 00000100:00100000:2.0:1787387866.308824:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690867712 00000100:00100000:2.0:1787387866.308884:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 214 00000100:00100000:2.0:1787387866.308894:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+59:11602:x1874211690867712:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1787387866.308920:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387866.308943:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c84ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b90 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.309005:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.309027:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c84ec lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b90 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.309047:0:5809:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.309062:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c84ec lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b90 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.309075:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387866.309078:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387866.309082:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c84ec lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b90 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387866.309089:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90600, rc 0) 00000100:00100000:2.0:1787387866.309144:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:11602:x1874211690867712:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 252us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387866.309151:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 214 00010000:00010000:2.0:1787387866.462030:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787387866.834826:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1787387866.834846:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:3.0:1787387867.102119:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787387867.102130:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787387867.102164:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787387867.102171:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787387867.102298:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d12680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709729792:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787387867.102406:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4344ef50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387867.109295:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d12680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709729792:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787387867.115905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.116029:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690867840 00000100:00100000:2.0:1787387867.116040:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690867840 00000100:00100000:2.0:1787387867.116102:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 215 00000100:00100000:2.0:1787387867.116112:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:11603:x1874211690867840:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787387867.116154:0:5808:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787387867.116273:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:11603:x1874211690867840:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 154us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387867.116282:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 215 00000100:00100000:1.0:1787387867.123224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.123684:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690867968 00000100:00100000:2.0:1787387867.123697:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690867968 00000100:00100000:2.0:1787387867.123803:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 216 00000100:00100000:2.0:1787387867.123814:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:11603:x1874211690867968:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787387867.123883:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c84f3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.123899:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c84f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.123911:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c84f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.123926:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c84fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.123933:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c84fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.123939:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c84fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.123982:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.123989:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.123996:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387867.124039:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787387867.124044:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787387867.124055:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124066:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c84f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124073:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c84f3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124079:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c84f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124084:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387867.124088:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c84f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124095:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c84f3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124107:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:2.0:1787387867.124116:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387867.124121:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c84f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124126:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91800/0x93d41aeaa23c84f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124139:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c84fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124159:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c84fa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124858:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c84fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124869:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387867.124873:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c84fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124880:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c84fa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124890:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8d436f2f6800) 00010000:00010000:2.0:1787387867.124893:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387867.124896:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c84fa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124902:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c84fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124920:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124934:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8501 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124940:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124946:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387867.124949:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124955:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124962:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387867.124965:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387867.124968:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8501 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.124973:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91000/0x93d41aeaa23c8501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387867.125240:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:11603:x1874211690867968:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 1424us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387867.125251:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 216 00000100:00100000:3.0:1787387867.152871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.152970:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690868224 00000100:00100000:2.0:1787387867.152982:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690868224 00000100:00100000:2.0:1787387867.153057:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 217 00000100:00100000:2.0:1787387867.153067:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+60:11603:x1874211690868224:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787387867.153087:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387867.153124:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8508 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b97 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153229:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c850f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153247:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c850f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153270:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c850f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387867.153283:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787387867.153385:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c850f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153394:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c850f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153400:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c850f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153407:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387867.153411:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c850f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153419:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c850f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153431:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387867.153435:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787387867.153440:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c850f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153470:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c850f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153895:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8508 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b97 expref: 62 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153907:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:2.0:1787387867.153910:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787387867.153914:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c8508 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b97 expref: 62 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.153925:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fc600, rc 0) 00000100:00100000:2.0:1787387867.153999:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:11603:x1874211690868224:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 920us (1125us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787387867.154008:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 217 00000100:00100000:1.0:1787387867.158714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387867.158857:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690868352 00000100:00100000:0.0:1787387867.158867:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690868352 00000100:00100000:0.0:1787387867.158952:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 218 00000100:00100000:0.0:1787387867.158962:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:11603:x1874211690868352:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787387867.159031:0:5807:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787387867.159774:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:11603:x1874211690868352:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 809us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387867.159784:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 218 00000100:00100000:0.0:1787387867.172839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.177108:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690868608 00000100:00100000:2.0:1787387867.177131:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690868608 00000100:00100000:2.0:1787387867.177785:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 219 00000100:00100000:2.0:1787387867.177797:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:11603:x1874211690868608:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787387867.177817:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387867.177820:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787387867.177847:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70e00/0x93d41aeaa23c84ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b7b expref: 61 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.177868:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:2.0:1787387867.177872:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787387867.177899:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c851d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52b9e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787387867.178295:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787387867.178513:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.178526:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.178536:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.178599:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c851d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b9e expref: 63 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.178616:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b9e expref: 62 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.178624:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d436f2f6800) 00010000:00010000:2.0:1787387867.178626:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787387867.178629:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fd000, rc 0) 00000100:00100000:2.0:1787387867.178699:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+62:11603:x1874211690868608:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 905us (5870us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787387867.178708:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 219 00000100:00100000:3.0:1787387867.184193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.184432:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690868864 00000100:00100000:2.0:1787387867.184443:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690868864 00000100:00100000:2.0:1787387867.184644:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 220 00000100:00100000:2.0:1787387867.184655:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+62:11603:x1874211690868864:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787387867.184769:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387867.184796:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c8524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b9e expref: 62 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.184818:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d436f2f6800) 00010000:00010000:2.0:1787387867.184830:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787387867.184855:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c8532 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.184880:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c8532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.184890:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c8532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.184904:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c8539 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x67b5a120 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.184912:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c8539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x67b5a120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.184919:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c8539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x67b5a120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185000:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c8532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185007:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c8532 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185014:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c8532 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185025:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387867.185030:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c8532 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185039:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c8532 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185048:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:2.0:1787387867.185050:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387867.185054:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c8532 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185059:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c8532 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185070:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c8539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x67b5a120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185075:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c8539 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x67b5a120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185081:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c8539 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x67b5a120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185086:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387867.185089:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c8539 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x67b5a120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185094:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c8539 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x67b5a120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185112:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x67b5a120 (ffff8d436f2f6000) 00010000:00010000:2.0:1787387867.185115:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387867.185117:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c8539 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x67b5a120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.185124:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c8539 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x67b5a120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387867.185212:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:11603:x1874211690868864:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 559us (1027us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387867.185220:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 220 00000100:00100000:0.0:1787387867.195950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387867.196033:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690868992 00000100:00100000:3.0:1787387867.196043:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690868992 00000100:00100000:3.0:1787387867.196108:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 221 00000100:00100000:3.0:1787387867.196119:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+61:11603:x1874211690868992:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387867.196261:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387867.196290:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8540 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52ba5 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.196403:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.196437:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.196449:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.196845:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8540 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ba5 expref: 63 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.196863:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ba5 expref: 62 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.196872:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:3.0:1787387867.196875:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787387867.196878:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460ac00, rc 0) 00000100:00100000:3.0:1787387867.197016:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+62:11603:x1874211690868992:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 898us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387867.197024:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 221 00000100:00100000:3.0:1787387867.203287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387867.207072:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690869248 00000100:00100000:0.0:1787387867.207090:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690869248 00000100:00100000:0.0:1787387867.207167:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 222 00000100:00100000:0.0:1787387867.207179:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+62:11603:x1874211690869248:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787387867.207724:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c854e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.207778:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c854e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.207792:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c854e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787387867.208134:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1787387867.208144:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371657404390ns, next at 372657402153ns, rc = 0 00000004:00010000:0.0:1787387867.208891:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000516a7322 reply state 00000000b59859ab transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c854e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387867.208905:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387867.209152:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+64:11603:x1874211690869248:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1972us (5872us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787387867.209161:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 222 00010000:00010000:0.0:1787387867.211635:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c854e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.211654:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c854e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.211662:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c854e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.211668:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387867.211672:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c854e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.211680:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c854e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.211717:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:0.0:1787387867.211720:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787387867.211726:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c854e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.211732:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70200/0x93d41aeaa23c854e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387867.214845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387867.214972:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690869376 00000100:00100000:1.0:1787387867.214983:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690869376 00000100:00100000:1.0:1787387867.216824:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 223 00000100:00100000:1.0:1787387867.216844:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+63:11603:x1874211690869376:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787387867.216872:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387867.216895:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8555 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52bac expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.216960:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bac expref: 64 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.216975:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bac expref: 64 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.217221:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:1.0:1787387867.217225:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787387867.217229:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152fc00, rc 0) 00000100:00100000:1.0:1787387867.217375:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+64:11603:x1874211690869376:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 464us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387867.217384:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 223 00000100:00100000:3.0:1787387867.226151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.227031:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690869504 00000100:00100000:2.0:1787387867.227045:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690869504 00000100:00100000:2.0:1787387867.227133:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:2.0:1787387867.227155:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2350:x1874211690869504:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787387867.227505:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:2350:x1874211690869504:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 352us (1374us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787387867.227513:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00080000:3.0:1787387867.228464:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387867.234792:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.235029:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690869760 00000100:00100000:2.0:1787387867.235041:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690869760 00000100:00100000:2.0:1787387867.235106:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:2.0:1787387867.235118:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+64:11603:x1874211690869760:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787387867.235417:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+65:11603:x1874211690869760:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 300us (690us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787387867.235427:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:1.0:1787387867.250003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.250097:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690870016 00000100:00100000:2.0:1787387867.250108:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690870016 00000100:00100000:2.0:1787387867.250239:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00100000:2.0:1787387867.250266:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+65:11603:x1874211690870016:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787387867.250682:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+65:11603:x1874211690870016:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 418us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387867.250690:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00100000:0.0:1787387867.256798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387867.257629:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690870144 00000100:00100000:3.0:1787387867.257642:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690870144 00000100:00100000:3.0:1787387867.257716:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 225 00000100:00100000:3.0:1787387867.257728:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+65:11603:x1874211690870144:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387867.257797:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387867.257821:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c855c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52bb3 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.257894:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.257908:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.257919:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387867.257966:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387867.257988:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.258022:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b800/0x93d41aeaa23c855c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bb3 expref: 67 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.258042:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bb3 expref: 66 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.258051:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:3.0:1787387867.258055:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787387867.258059:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a600, rc 0) 00000100:00100000:3.0:1787387867.259735:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+66:11603:x1874211690870144:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1999us (2940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387867.259758:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 225 00000100:00100000:3.0:1787387867.271312:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.271716:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690870272 00000100:00100000:2.0:1787387867.271728:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690870272 00000100:00100000:2.0:1787387867.271837:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:2.0:1787387867.271848:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+10:2352:x1874211690870272:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787387867.271868:0:11067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387867.271891:0:11067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cb6d761/0x93d41aeaa23c856a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52bba expref: -99 pid: 11067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787387867.271922:0:11067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a895fdb, blocks: 0x1 00010000:00010000:2.0:1787387867.271945:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1787387867.271949:0:11067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387867.271957:0:11067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cb6d761/0x93d41aeaa23c856a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bba expref: 11 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.271977:0:11067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004cb6d761/0x93d41aeaa23c856a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bba expref: 11 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.271991:0:11067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fd600, rc 0) 00000100:00100000:2.0:1787387867.272052:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:2352:x1874211690870272:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 206us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387867.272074:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1787387867.278821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387867.278971:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690870528 00000100:00100000:3.0:1787387867.278982:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690870528 00000100:00100000:3.0:1787387867.279112:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 226 00000100:00100000:3.0:1787387867.279123:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+66:11603:x1874211690870528:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787387867.279238:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+66:11603:x1874211690870528:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 117us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387867.279247:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 226 00000100:00100000:0.0:1787387867.294036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.296106:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690870656 00000100:00100000:2.0:1787387867.296122:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690870656 00000100:00100000:2.0:1787387867.296182:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:2.0:1787387867.296192:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:11603:x1874211690870656:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787387867.296211:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387867.296231:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52bc1 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.296262:0:6606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004cb6d761/0x93d41aeaa23c856a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bba expref: 12 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.296271:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387867.296275:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387867.296280:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 12 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.296317:0:6606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004cb6d761/0x93d41aeaa23c856a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bba expref: 12 pid: 11067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.296331:0:6606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004cb6d761/0x93d41aeaa23c856a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bba expref: 12 pid: 11067 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387867.296346:0:6606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6606:1874211709729920:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387867.296458:0:6606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347ddad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387867.307786:0:6606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6606:1874211709729920:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387867.307832:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 12 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.307855:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fc200, rc 0) 00000100:00100000:2.0:1787387867.307925:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+12:11603:x1874211690870656:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 11732us (13898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387867.307936:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:1.0:1787387867.312844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.313008:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690870784 00000100:00100000:2.0:1787387867.313019:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690870784 00010000:00010000:2.0:1787387867.313063:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004cb6d761/0x93d41aeaa23c856a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bba expref: 12 pid: 11067 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387867.313108:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:2.0:1787387867.313118:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+12:2351:x1874211690870784:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387867.313133:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387867.313159:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004cb6d761/0x93d41aeaa23c856a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bba expref: 12 pid: 11067 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.313174:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004cb6d761/0x93d41aeaa23c856a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bba expref: 12 pid: 11067 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.313202:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cb6d761/0x93d41aeaa23c856a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bba expref: 12 pid: 11067 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.313222:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387867.313243:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387867.313252:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 11 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.313263:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 11 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.313303:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 11 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387867.313319:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a2d8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5794:1874211709730048:192.168.204.59@tcp:105: 00000100:00100000:2.0:1787387867.313458:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347ddad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387867.323909:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a2d8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5794:1874211709730048:192.168.204.59@tcp:105: 00010000:00010000:2.0:1787387867.323940:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387867.324012:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:2351:x1874211690870784:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 10894us (11178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387867.324024:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:1.0:1787387867.327113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387867.327211:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690870912 00000100:00100000:0.0:1787387867.327222:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690870912 00002000:00100000:0.0:1787387867.327283:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d4345d05180 x1874211690870912/t0(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:123/0 lens 504/0 e 0 to 0 dl 1787387878 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787387867.327295:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4345d05180 with x1874211690870912 ext(0->12) 00002000:00010000:0.0:1787387867.327300:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4345d05180 00000100:00100000:0.0:1787387867.327337:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1787387867.327346:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+11:2353:x1874211690870912:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787387867.327923:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:2353:x1874211690870912:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 575us (817us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787387867.327932:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00002000:00100000:0.0:1787387867.327939:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d4345d05180 x1874211690870912/t4294967320(0) o4->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:123/0 lens 504/448 e 0 to 0 dl 1787387878 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787387867.327948:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4345d05180 with x1874211690870912 ext(0->12) 00002000:00010000:0.0:1787387867.327959:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4345d05180 00000100:00100000:1.0:1787387867.335791:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.335902:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690871040 00000100:00100000:2.0:1787387867.335914:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690871040 00000100:00100000:2.0:1787387867.335977:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 227 00000100:00100000:2.0:1787387867.335997:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+66:11603:x1874211690871040:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787387867.390155:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1787387867.390168:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787387867.390191:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:0.0:1787387867.390225:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1787387867.390251:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1787387867.390268:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+39:11603:x1874211690871040:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 54276us (54522us total) trans 0 rc 0/0 00000020:00080000:0.0:1787387867.390269:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d4373bb8a80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787387867.390273:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d43464ba300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d4373bb8600 00000020:00080000:0.0:1787387867.390276:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d43464ba000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d4345d1d800 00000100:00100000:3.0:1787387867.390280:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 227 00000020:00080000:0.0:1787387867.390313:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d43437b03c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787387867.390317:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d43464baf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d43437b09c0 00000020:00080000:0.0:1787387867.390320:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d43464bae00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d437ab55800 00000100:00100000:2.0:1787387867.390627:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:0.0:1787387867.390667:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787387867.390923:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787387867.390941:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709730304:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787387867.390993:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387867.391110:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387867.391117:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437fdb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709730432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787387867.391142:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387867.392917:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437fdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709730176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787387867.392921:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709730304 00000100:00100000:3.0:1787387867.392929:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709730304 00000100:00100000:2.0:1787387867.392974:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387867.393022:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709730432 00000100:00100000:3.0:1787387867.393026:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709730432 00000100:00100000:2.0:1787387867.393032:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709730176 00000100:00100000:2.0:1787387867.393035:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709730176 00000100:00080000:0.0:1787387867.393055:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787387867.393059:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387867.393069:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787387867.393078:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709730304:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787387867.393086:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787387867.393093:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1874211709730176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787387867.393108:0:6606:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00080000:0.0:1787387867.393108:0:6605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1787387867.393132:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787387867.393138:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a895fd9, atime: 0x6a895fd9, ctime: 0x6a895fd9, blocks: 0xb 00010000:00010000:2.0:1787387867.393143:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b4d8b54/0x93d41aeaa23c857f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.393157:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1787387867.393161:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387867.393162:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c833a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b20 expref: 12 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.393170:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787387867.393173:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787387867.393178:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.393181:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b4d8b54/0x93d41aeaa23c857f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.393194:0:6606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b4d8b54/0x93d41aeaa23c857f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.393203:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b4d8b54/0x93d41aeaa23c857f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.393208:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c833a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b20 expref: 12 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.393212:0:6606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b4d8b54/0x93d41aeaa23c857f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.393222:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c833a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b20 expref: 12 pid: 6606 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.393229:0:6606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787387867.393234:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6605:1874211709730560:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387867.393293:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374241e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387867.395376:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874211709730304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2291us (4375us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787387867.395388:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787387867.396176:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787387867.396196:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874211709730432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787387867.396427:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787387867.396431:0:6604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787387867 00002000:00010000:1.0:1787387867.396433:0:6604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787387867.396435:0:6604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787387867 -> 1787387867 00002000:00010000:1.0:1787387867.396437:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787387867.396492:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3313:x1874211709730432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 305us (5348us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787387867.396499:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1787387867.397110:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387867.397120:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b4d8b54/0x93d41aeaa23c857f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.397144:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387867.397149:0:11539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b4d8b54/0x93d41aeaa23c857f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.397161:0:11539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b4d8b54/0x93d41aeaa23c857f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.397183:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b4d8b54/0x93d41aeaa23c857f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.397191:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b4d8b54/0x93d41aeaa23c857f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.397210:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387867.397212:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387867.397213:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387867.398018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000004:00080000:0.0:1787387867.398096:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d437fdb9c00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787387867.398105:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437fdb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709730432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787387867.398122:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000100:00100000:3.0:1787387867.398124:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690871168 00000004:00080000:0.0:1787387867.398129:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d437a087b80, transno 4294967307 00000100:00100000:3.0:1787387867.398133:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690871168 00000004:00080000:0.0:1787387867.398153:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1787387867.398179:0:3313:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d437ab46680 x1874211709730304/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787387883 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787387867.398188:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d437ab46680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787387867.398205:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709730304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787387867.398579:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:3.0:1787387867.398589:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:2352:x1874211690871168:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787387867.399133:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6605:1874211709730560:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387867.399153:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387867.402551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.402908:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690871296 00000100:00100000:2.0:1787387867.402920:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690871296 00010000:00010000:2.0:1787387867.402960:0:8324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c833a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b20 expref: 14 pid: 6606 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387867.403004:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:2.0:1787387867.403014:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+14:2350:x1874211690871296:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787387867.403035:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387867.403041:0:8324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c833a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b20 expref: 14 pid: 6606 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.403065:0:8324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c833a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b20 expref: 14 pid: 6606 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.403091:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031539229/0x93d41aeaa23c833a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b20 expref: 14 pid: 6606 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.403107:0:8324:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387867.403111:0:8324:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787387867.403117:0:8324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.403453:0:8324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.403487:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387867.403559:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+13:2350:x1874211690871296:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 546us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387867.403568:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 81 00010000:00010000:0.0:1787387867.403954:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.403965:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.403976:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.403984:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.404003:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787387867.409504:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387867.409521:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.409547:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70c00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387867.409553:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.409592:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.409629:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.409638:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8578 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.409669:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387867.409672:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387867.409673:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387867.410173:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1874211709730176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17076us (17194us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787387867.410183:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1787387867.410253:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d437fdbad80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787387867.410260:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437fdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709730176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787387867.456841:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+12:2352:x1874211690871168:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 58230us (58805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387867.456858:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000001:00080000:2.0:1787387867.457256:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1787387867.457274:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:2.0:1787387867.457282:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1787387867.462878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.465213:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690871552 00000100:00100000:2.0:1787387867.465230:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690871552 00000100:00100000:3.0:1787387867.465591:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 228 00000100:00100000:3.0:1787387867.465606:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:11603:x1874211690871552:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787387867.465670:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387867.465698:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c8563 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bb3 expref: 20 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.465736:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:3.0:1787387867.468409:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787387867.468653:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8586 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.468692:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.468706:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787387867.469024:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a8298923 reply state 000000004e7be248 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387867.469036:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787387867.469534:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:11603:x1874211690871552:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 3926us (6659us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787387867.469554:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 228 00010000:00010000:0.0:1787387867.474193:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.474212:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8586 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.474220:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.474240:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fda00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387867.474244:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.474253:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8586 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.474268:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:0.0:1787387867.474271:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387867.474276:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8586 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.474282:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c8586 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387867.475424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.475947:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690871680 00000100:00100000:2.0:1787387867.475960:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690871680 00000100:00100000:2.0:1787387867.476774:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:2.0:1787387867.476789:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2353:x1874211690871680:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787387867.479261:0:6606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787387867.479272:0:6606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787387867 -> 1787387866 00002000:00010000:2.0:1787387867.479274:0:6606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787387865 00002000:00010000:2.0:1787387867.479276:0:6606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787387867 -> 1787387866 00002000:00010000:2.0:1787387867.479279:0:6606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787387867.479648:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2353:x1874211690871680:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 2858us (4224us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787387867.479659:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:1.0:1787387867.484053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387867.484220:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690871936 00000100:00100000:3.0:1787387867.484231:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690871936 00000100:00100000:3.0:1787387867.484407:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 229 00000100:00100000:3.0:1787387867.484419:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:11603:x1874211690871936:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787387867.484501:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.484518:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8547 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ba5 expref: 20 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.484526:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.484575:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ba5 expref: 20 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.484589:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ba5 expref: 20 pid: 6840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387867.484604:0:6840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d11500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709730688:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387867.484694:0:6840:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350d12180 going to sleep for 11 seconds 00010000:00010000:3.0:1787387867.488174:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387867.488439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387867.489015:0:6840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d11500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1874211709730688:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387867.489044:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387867.489277:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690872064 00000100:00100000:3.0:1787387867.489285:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690872064 00010000:00010000:3.0:1787387867.489415:0:11042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ba5 expref: 21 pid: 6840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387867.489466:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:3.0:1787387867.489476:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:2350:x1874211690872064:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387867.489490:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387867.489498:0:11042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ba5 expref: 21 pid: 6840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.489514:0:11042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ba5 expref: 21 pid: 6840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.489551:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ba5 expref: 21 pid: 6840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.489567:0:11042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:3.0:1787387867.489571:0:11042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.489581:0:11042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.489590:0:11042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.489622:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387867.489675:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:2350:x1874211690872064:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 200us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387867.489683:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 82 00010000:00010000:1.0:1787387867.489842:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.489851:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.489881:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.489889:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.489896:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.489903:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387867.489914:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.489923:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.489932:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:1.0:1787387867.489935:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787387867.489939:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.489945:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a600/0x93d41aeaa23c858d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387867.489997:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:11603:x1874211690871936:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 5580us (6019us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787387867.490007:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 229 00000100:00100000:2.0:1787387867.494306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387867.494461:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690872192 00000100:00100000:3.0:1787387867.494472:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690872192 00000100:00100000:3.0:1787387867.494533:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:3.0:1787387867.494558:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2353:x1874211690872192:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787387867.494604:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.494627:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 8 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.494634:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387867.494639:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787387867.494643:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.494678:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 8 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.494692:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 8 pid: 6606 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387867.494710:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6605:1874211709730816:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387867.495238:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350d12900 going to sleep for 11 seconds 00000100:00100000:3.0:1787387867.498993:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6605:1874211709730816:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387867.499023:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387867.501638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387867.502094:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690872320 00000100:00100000:3.0:1787387867.502105:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690872320 00010000:00010000:3.0:1787387867.502160:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 9 pid: 6606 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387867.502214:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:3.0:1787387867.502224:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+9:2350:x1874211690872320:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387867.502238:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387867.502264:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 9 pid: 6606 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.502278:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 9 pid: 6606 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.502315:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f39e29b2/0x93d41aeaa23c8571 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc1 expref: 9 pid: 6606 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.502336:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787387867.502340:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787387867.502346:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.502355:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.502402:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387867.502735:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690872320:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 511us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387867.502763:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00010000:00010000:1.0:1787387867.505123:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.505144:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.505191:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.505200:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.505229:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.505237:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b800 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387867.505242:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.505252:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.505276:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.505284:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8594 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387867.505409:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2353:x1874211690872192:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 10850us (11122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387867.505422:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:2.0:1787387867.511122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387867.511207:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690872576 00000100:00100000:3.0:1787387867.511218:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690872576 00000100:00100000:3.0:1787387867.511280:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 230 00000100:00100000:3.0:1787387867.511290:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:11603:x1874211690872576:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787387867.511386:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c859b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.511405:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c859b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.511416:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c859b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.511657:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.511669:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8555 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bac expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.511677:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.511713:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bac expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.511785:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8555 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bac expref: 20 pid: 5808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387867.511802:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709730944:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387867.511888:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350d12900 going to sleep for 11 seconds 00000100:00100000:3.0:1787387867.515268:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709730944:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387867.515311:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387867.518812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387867.519020:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690872704 00000100:00100000:0.0:1787387867.519032:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690872704 00010000:00010000:0.0:1787387867.519074:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8555 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bac expref: 21 pid: 5808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387867.519111:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:0.0:1787387867.519130:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:2351:x1874211690872704:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387867.519147:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387867.519154:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8555 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bac expref: 21 pid: 5808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.519190:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bac expref: 21 pid: 5808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.519212:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152fc00/0x93d41aeaa23c8555 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bac expref: 21 pid: 5808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.519229:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:0.0:1787387867.519234:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.519243:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.519251:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.519284:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787387867.519458:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.519467:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787387867.519660:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787387867.519822:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787387867.519861:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787387867.519938:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374489180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1874211709731072:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787387867.519998:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387867.520024:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347ddaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387867.520177:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709731072 00000100:00100000:1.0:1787387867.520183:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709731072 00000100:00100000:1.0:1787387867.520230:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787387867.520238:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1874211709731072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787387867.520320:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1874211709731072:12345-0@lo:1000:mdt00_002.0 Request processed in 81us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387867.520339:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387867.520607:0:5809:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1787387867.520614:0:5809:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1787387867.520632:0:5809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d437fdb9c00, transno 4294967321 00000100:00100000:2.0:1787387867.520655:0:5809:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d437fdbad80 x1874211709730176/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787387883 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387867.520666:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374489180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1874211709731072:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787387867.521388:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:2351:x1874211690872704:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 2264us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387867.521397:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00000001:00080000:2.0:1787387867.523670:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787387867.523804:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab87480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1874211709731200:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787387867.523867:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387867.523904:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda840 going to sleep for 11 seconds 00000100:00100000:1.0:1787387867.524457:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709731200 00000100:00100000:1.0:1787387867.524465:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709731200 00000100:00100000:1.0:1787387867.524522:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787387867.524531:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1874211709731200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787387867.525021:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5809:x1874211709731200:12345-0@lo:1000:mdt00_002.0 Request processed in 489us (1150us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787387867.525030:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387867.526246:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab87480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1874211709731200:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787387867.526410:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526421:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526460:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526466:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460aa00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387867.526470:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526478:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526494:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d4343c2d800) 00010000:00010000:2.0:1787387867.526498:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387867.526502:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526509:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c85a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526681:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526690:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526695:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526701:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387867.526705:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526722:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526731:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387867.526734:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787387867.526787:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c84ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b90 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526800:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c84ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b90 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526810:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c84ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b90 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.526848:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c84ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b90 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387867.526864:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709731328:192.168.204.59@tcp:105: 00000100:00100000:2.0:1787387867.526948:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387867.532473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387867.532585:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690872832 00000100:00100000:3.0:1787387867.532597:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690872832 00000100:00100000:3.0:1787387867.532657:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:3.0:1787387867.532668:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:11602:x1874211690872832:12345-192.168.204.59@tcp:49:lfs.0 00000100:00100000:3.0:1787387867.532845:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+24:11602:x1874211690872832:12345-192.168.204.59@tcp:49:lfs.0 Request processed in 177us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387867.532853:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:2.0:1787387867.534265:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1874211709731328:192.168.204.59@tcp:105: 00010000:00010000:2.0:1787387867.534370:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.534382:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c84e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.534420:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.534463:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.534475:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.534486:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.534492:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.534498:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.534503:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fda00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387867.534507:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.534514:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.534525:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387867.534528:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387867.534531:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.537623:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.537653:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c859b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.537683:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c859b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.537690:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c859b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.537696:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ac00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387867.537701:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c859b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.537708:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c859b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.537728:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387867.537731:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787387867.537736:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c859b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.537772:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c859b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787387867.539466:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787387867.539475:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787387867.540822:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:11603:x1874211690872576:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 29523us (29699us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787387867.540838:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 230 00000020:00080000:2.0:1787387867.540846:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787387867.541641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387867.541838:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690873088 00000100:00100000:0.0:1787387867.541848:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690873088 00000100:00100000:0.0:1787387867.541898:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 231 00000100:00100000:0.0:1787387867.541909:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:11602:x1874211690873088:12345-192.168.204.59@tcp:58:lfs.0 00000040:00080000:3.0:1787387867.543105:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787387867.543896:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787387867.544017:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:11602:x1874211690873088:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 2105us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387867.544041:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 231 00000040:00080000:3.0:1787387867.544718:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787387867.551497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387867.551710:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690873344 00000100:00100000:3.0:1787387867.551721:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690873344 00000100:00100000:3.0:1787387867.551812:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:3.0:1787387867.551822:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d436567a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+23:11603:x1874211690873344:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787387867.553405:0:5811:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787387867.553519:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787387867.553581:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c85b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.553597:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c85b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.553610:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c85b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.553619:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c85b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.553626:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c85b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.553632:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c85b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387867.553655:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787387867.553801:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d436567a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+25:11603:x1874211690873344:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 1976us (2311us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787387867.553812:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00000020:00080000:3.0:1787387867.553818:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787387867.554106:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387867.554113:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c85b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.554122:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387867.554135:0:11539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c85b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.554145:0:11539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c85b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.554160:0:11539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d4343c2d500) 00010000:00010000:2.0:1787387867.554164:0:11539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787387867.554187:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c85b0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.554193:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c85b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.554212:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387867.554214:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387867.554216:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387867.585606:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387867.585774:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690873472 00000100:00100000:2.0:1787387867.585786:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690873472 00000100:00100000:2.0:1787387867.585852:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 232 00000100:00100000:2.0:1787387867.585863:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+25:11605:x1874211690873472:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1787387867.585887:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387867.585908:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52bc8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.585973:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c85be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.585998:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c85be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.586011:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c85be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.586043:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c85c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.586051:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c85c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.586058:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c85c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.586371:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.586382:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b89 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.586391:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.586425:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b89 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387867.586438:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b89 expref: 26 pid: 5807 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387867.586453:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709731456:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387867.586994:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347ddad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387867.590655:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1874211709731456:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387867.590684:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387867.592800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387867.592886:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690873728 00000100:00100000:0.0:1787387867.592896:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690873728 00000100:00100000:0.0:1787387867.592969:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1787387867.592985:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:5566:x1874211690873728:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787387867.593271:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:5566:x1874211690873728:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 292us (480us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787387867.593279:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:1.0:1787387867.596841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387867.596942:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690873856 00000100:00100000:0.0:1787387867.596962:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690873856 00010000:00010000:0.0:1787387867.597551:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b89 expref: 28 pid: 5807 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387867.597659:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:0.0:1787387867.597673:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:2350:x1874211690873856:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387867.597692:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387867.597700:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b89 expref: 28 pid: 5807 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.597714:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b89 expref: 28 pid: 5807 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.597736:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71400/0x93d41aeaa23c84d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b89 expref: 28 pid: 5807 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.597785:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:0.0:1787387867.597804:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.597815:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.597822:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387867.597862:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387867.597931:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+27:2350:x1874211690873856:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 262us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387867.597944:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00010000:00010000:1.0:1787387867.598338:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598348:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387867.598395:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787387867.598399:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787387867.598418:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598444:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598456:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c85be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598470:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c85be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598476:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c85be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598481:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387867.598486:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c85be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598493:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c85be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598503:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:1.0:1787387867.598506:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387867.598509:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c85be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598515:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc600/0x93d41aeaa23c85be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598529:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c85c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598546:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c85c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598553:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c85c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598558:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387867.598568:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c85c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598574:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c85c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598583:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d436f2f6c00) 00010000:00010000:1.0:1787387867.598585:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387867.598588:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c85c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598593:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd600/0x93d41aeaa23c85c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598633:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc8 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598646:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc8 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387867.598654:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:1.0:1787387867.598656:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787387867.598658:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fc200, rc 0) 00000100:00100000:1.0:1787387867.598704:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:11605:x1874211690873472:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 12844us (13107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387867.598713:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 232 00010000:00010000:3.0:1787387868.513545:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787387868.513842:0:12441:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787387868.513848:0:12441:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787387868.513892:0:12441:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787387868.513898:0:12441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787387868.574445:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787387868.574454:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787387868.574494:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787387868.574500:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787387868.577403:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d13480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709731584:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787387868.579081:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387868.600129:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d13480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1874211709731584:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787387868.609311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387868.609542:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690873984 00000100:00100000:1.0:1787387868.609552:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690873984 00000100:00100000:1.0:1787387868.609630:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 233 00000100:00100000:1.0:1787387868.609643:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4373d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:11617:x1874211690873984:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787387868.609722:0:6840:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787387868.609866:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4373d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:11617:x1874211690873984:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 226us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387868.609874:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 233 00000100:00080000:3.0:1787387868.611114:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387868.613068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387868.613154:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690874240 00000100:00100000:2.0:1787387868.613175:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690874240 00000100:00100000:2.0:1787387868.613236:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 234 00000100:00100000:2.0:1787387868.613247:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+26:11617:x1874211690874240:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787387868.613268:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387868.613293:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52bcf expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.613393:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.613407:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.613434:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387868.613446:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787387868.613679:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bcf expref: 29 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.613699:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bcf expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.613708:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387868.613711:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787387868.613715:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fda00, rc 0) 00000100:00100000:1.0:1787387868.615393:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:11617:x1874211690874240:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 2138us (2329us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787387868.615406:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 234 00000100:00100000:2.0:1787387868.622384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387868.622499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387868.622530:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690874624 00000100:00100000:2.0:1787387868.622540:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690874624 00000100:00100000:2.0:1787387868.622584:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 235 00000100:00100000:2.0:1787387868.622593:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:11617:x1874211690874624:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787387868.622664:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.622680:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.622692:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.622906:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.622913:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.622920:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.622926:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387868.622930:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.622937:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.622950:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:2.0:1787387868.622953:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787387868.622965:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387868.622971:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd000/0x93d41aeaa23c85e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387868.623117:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:11617:x1874211690874624:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 524us (617us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787387868.623126:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 235 00000040:00080000:2.0:1787387868.623331:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387868.623337:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787387868.623815:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787387868.623823:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787387868.623980:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690874368 00000100:00100000:1.0:1787387868.623988:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690874368 00000100:00100000:1.0:1787387868.624039:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1787387868.624048:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:2351:x1874211690874368:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787387868.624062:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387868.624084:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fda00/0x93d41aeaa23c85da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bcf expref: 29 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387868.624099:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:1.0:1787387868.624103:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387868.624142:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:2351:x1874211690874368:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 94us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387868.624149:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1787387868.630547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387868.633988:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690874880 00000100:00100000:0.0:1787387868.634006:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690874880 00000100:00100000:3.0:1787387868.640181:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:3.0:1787387868.640198:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+28:11617:x1874211690874880:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787387868.640634:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:11617:x1874211690874880:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 439us (10221us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787387868.640643:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:3.0:1787387868.769477:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709731840:0@lo:400:kworker.0 00000100:00100000:3.0:1787387868.769575:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387868.769617:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709732352:0@lo:400:kworker.0 00000100:00100000:3.0:1787387868.769643:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387868.769670:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787387868.769675:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709731712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387868.769698:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387868.769713:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709732224:0@lo:400:kworker.0 00000100:00100000:3.0:1787387868.769731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387868.769785:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709732096:0@lo:400:kworker.0 00000100:00100000:3.0:1787387868.769808:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387868.769824:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787387868.769829:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709731968:0@lo:400:kworker.0 00000100:00100000:3.0:1787387868.769846:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387868.769862:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4373d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709732480:0@lo:400:kworker.0 00000100:00100000:3.0:1787387868.769889:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387868.769920:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709731840 00000100:00100000:3.0:1787387868.769928:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709731840 00000100:00100000:3.0:1787387868.770230:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787387868.770240:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709731840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387868.770372:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709731840:12345-0@lo:400:kworker.0 Request processed in 133us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387868.770380:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787387868.770422:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709732352 00000100:00100000:3.0:1787387868.770427:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709732352 00000100:00100000:3.0:1787387868.770458:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709732096 00000100:00100000:3.0:1787387868.770460:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709732096 00000100:00100000:3.0:1787387868.770471:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709731968 00000100:00100000:3.0:1787387868.770473:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709731968 00000100:00100000:2.0:1787387868.770638:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709732224 00000100:00100000:2.0:1787387868.770642:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709732224 00000100:00100000:2.0:1787387868.770669:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709732480 00000100:00100000:2.0:1787387868.770671:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709732480 00000100:00100000:2.0:1787387868.770687:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787387868.770693:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1874211709732224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387868.770732:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1874211709732224:12345-0@lo:400:kworker.0 Request processed in 40us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387868.770756:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787387868.770769:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787387868.770775:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709732480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387868.770805:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874211709732480:12345-0@lo:400:kworker.0 Request processed in 31us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387868.770811:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787387868.771007:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787387868.771016:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709732352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387868.771049:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709732352:12345-0@lo:400:kworker.0 Request processed in 35us (1405us total) trans 0 rc 0/0 00000100:00080000:0.0:1787387868.772712:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387868.772797:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709732480:0@lo:400:kworker.0 00000100:00100000:0.0:1787387868.772844:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709732224:0@lo:400:kworker.0 00000100:00100000:0.0:1787387868.772855:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709731840:0@lo:400:kworker.0 00000100:00100000:0.0:1787387868.772865:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709732352:0@lo:400:kworker.0 00000100:00100000:0.0:1787387868.773342:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709731712 00000100:00100000:0.0:1787387868.773350:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709731712 00000100:00100000:0.0:1787387868.773400:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787387868.773472:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709731712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387868.774588:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387868.774677:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709731712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1267us (4975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387868.774685:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787387868.774795:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787387868.774809:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709732096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387868.774866:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709732096:12345-0@lo:400:kworker.0 Request processed in 62us (5057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387868.774873:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787387868.774894:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787387868.774900:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709731968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387868.774929:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709731968:12345-0@lo:400:kworker.0 Request processed in 30us (5082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387868.774934:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787387868.775665:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787387868.776409:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709731968:0@lo:400:kworker.0 00000100:00100000:2.0:1787387868.776545:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4373d13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709732096:0@lo:400:kworker.0 00000100:00100000:1.0:1787387868.777153:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709731712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787387869.533979:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387869.790434:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709732608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387869.790520:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387869.790619:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709732608 00000100:00100000:3.0:1787387869.790628:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709732608 00000100:00100000:3.0:1787387869.790685:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787387869.790695:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874211709732608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787387869.790734:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387869.790805:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874211709732608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387869.790813:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1787387869.790833:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387869.790871:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709732608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787387870.558302:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387870.633701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387870.633767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387870.633793:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387870.633811:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387870.633835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387870.633862:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690875264 00000100:00100000:0.0:1787387870.633872:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690875264 00000100:00100000:0.0:1787387870.633923:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690875392 00000100:00100000:0.0:1787387870.633927:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690875392 00000100:00100000:0.0:1787387870.633951:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:0.0:1787387870.633960:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690875264:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387870.634033:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2350:x1874211690875264:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 73us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387870.634041:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:0.0:1787387870.634058:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:0.0:1787387870.634064:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690875392:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387870.634086:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2350:x1874211690875392:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387870.634092:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:0.0:1787387870.634108:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690875520 00000100:00100000:0.0:1787387870.634111:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690875520 00000100:00100000:0.0:1787387870.634134:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690875136 00000100:00100000:0.0:1787387870.634147:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690875136 00000100:00100000:0.0:1787387870.634164:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 176 00000100:00100000:0.0:1787387870.634169:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690875520:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387870.634193:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2350:x1874211690875520:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387870.634199:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 176 00000100:00100000:0.0:1787387870.634208:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00100000:0.0:1787387870.634213:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:2350:x1874211690875136:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387870.634241:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:2350:x1874211690875136:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387870.634247:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00080000:0.0:1787387870.634267:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787387870.634272:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787387870.634274:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387870.634626:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690875008 00000100:00100000:2.0:1787387870.634631:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690875008 00000100:00100000:2.0:1787387870.634669:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 305 00000100:00100000:2.0:1787387870.634677:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690875008:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387870.634713:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690875008:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 39us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387870.634720:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 305 00000040:00080000:3.0:1787387870.680298:0:12492:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787387870.680311:0:12492:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787387870.680511:0:12492:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787387870.680517:0:12492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787387870.881670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387870.881706:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690875776 00000100:00100000:3.0:1787387870.881715:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690875776 00000100:00100000:3.0:1787387870.881797:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 236 00000100:00100000:3.0:1787387870.881807:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+29:11638:x1874211690875776:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387870.881830:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387870.881854:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c85ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52bd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387870.881969:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c85f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387870.881985:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c85f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387870.881997:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c85f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387870.882010:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787387870.882136:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c85ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bd6 expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387870.882165:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c85f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bd6 expref: 31 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387870.882174:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:3.0:1787387870.882178:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787387870.882181:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460b600, rc 0) 00000100:00100000:3.0:1787387870.882240:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+31:11638:x1874211690875776:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 434us (583us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787387870.882248:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 236 00000100:00100000:2.0:1787387870.890537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387870.890610:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690875904 00000100:00100000:1.0:1787387870.890621:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690875904 00000100:00100000:1.0:1787387870.890691:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 237 00000100:00100000:1.0:1787387870.890702:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+31:11638:x1874211690875904:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1787387870.892134:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8604 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387870.892156:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387870.892169:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387870.892200:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387870.892207:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8604 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387870.892215:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387870.892221:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387870.892226:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387870.892233:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8604 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387870.892245:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:1.0:1787387870.892248:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787387870.892252:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8604 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387870.892271:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d434152e800/0x93d41aeaa23c8604 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387870.893493:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+31:11638:x1874211690875904:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 2785us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387870.893505:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 237 00000100:00100000:3.0:1787387871.018210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387871.019136:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690876032 00000100:00100000:0.0:1787387871.019148:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690876032 00000100:00100000:0.0:1787387871.019292:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:0.0:1787387871.019306:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2351:x1874211690876032:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:0.0:1787387871.019326:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387871.019349:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c860b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52bdd expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787387871.019520:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a895fda, atime: 0x6a895fd9, ctime: 0x6a895fda, blocks: 0xb 00010000:00010000:0.0:1787387871.019542:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=375s v=(0 0) 00010000:00010000:0.0:1787387871.019547:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387871.019557:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c860b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bdd expref: 8 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387871.019589:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c860b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bdd expref: 8 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387871.019603:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71e00, rc 0) 00000100:00100000:0.0:1787387871.019679:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2351:x1874211690876032:12345-192.168.204.59@tcp:101:cat.0 Request processed in 376us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387871.019686:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:2.0:1787387871.023566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387871.023648:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690876160 00000100:00100000:3.0:1787387871.023659:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690876160 00002000:00100000:3.0:1787387871.023708:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d437ab86a00 x1874211690876160/t0(0) o3->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:127/0 lens 488/0 e 0 to 0 dl 1787387882 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787387871.023719:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d437ab86a00 with x1874211690876160 ext(0->4095) 00002000:00010000:3.0:1787387871.023724:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d437ab86a00 00000100:00100000:3.0:1787387871.023771:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1787387871.023790:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690876160:12345-192.168.204.59@tcp:3:cat.0 00000100:00100000:3.0:1787387871.024012:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+8:2350:x1874211690876160:12345-192.168.204.59@tcp:3:cat.0 Request processed in 224us (447us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787387871.024020:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00002000:00100000:3.0:1787387871.024027:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d437ab86a00 x1874211690876160/t0(0) o3->d7138a1c-1444-4499-9235-7f89dd5ceb0b@192.168.204.59@tcp:127/0 lens 488/4536 e 0 to 0 dl 1787387882 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787387871.024035:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d437ab86a00 with x1874211690876160 ext(0->4095) 00002000:00010000:3.0:1787387871.024052:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d437ab86a00 00010000:00010000:3.0:1787387871.590435:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787387871.926488:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787387872.458287:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:1.0:1787387872.458319:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1787387872.458347:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:1.0:1787387872.458359:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d4347ddaf00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787387872.458364:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d43464baa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d4347ddacc0 00000020:00080000:1.0:1787387872.458368:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8d43464ba100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d435cb1f800 00000001:00080000:1.0:1787387872.458381:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787387872.458411:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787387872.458720:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1787387872.607779:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787387872.950472:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1787387872.950491:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1787387872.950498:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:2.0:1787387873.630851:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387873.886082:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437fdb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709732736:0@lo:400:kworker.0 00000100:00100000:1.0:1787387873.886540:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387873.886780:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387873.886791:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709732864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387873.886830:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387873.886913:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437fdb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709733248:0@lo:400:kworker.0 00000100:00100000:1.0:1787387873.886937:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387873.886966:0:11067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709733248 00000100:00100000:1.0:1787387873.886976:0:11067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709733248 00000100:00100000:1.0:1787387873.887039:0:11067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787387873.887065:0:11067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709733248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387873.887122:0:11067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709733248:12345-0@lo:400:kworker.0 Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387873.887128:0:11067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1787387873.887148:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387873.887329:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787387873.887337:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d437fdbad80, transno 4294967322 00000004:00080000:1.0:1787387873.887959:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787387873.887994:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437fdb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709733248:0@lo:400:kworker.0 00000100:00100000:0.0:1787387873.888480:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709732864 00000100:00100000:0.0:1787387873.888489:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709732864 00000100:00100000:0.0:1787387873.888554:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787387873.888566:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709732864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387873.888604:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787387873.888677:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709732864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387873.888684:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787387873.888918:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787387873.888950:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787387873.888956:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d437ab46680, transno 4294967310 00000100:00100000:1.0:1787387873.888976:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709732864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387873.889033:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437fdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709733376:0@lo:400:kworker.0 00000100:00100000:1.0:1787387873.889112:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387873.889183:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437fdb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709732992:0@lo:400:kworker.0 00000100:00100000:2.0:1787387873.889216:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387873.889257:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387873.889264:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437fdbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709733120:0@lo:400:kworker.0 00000100:00100000:2.0:1787387873.889290:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387873.889332:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709733376 00000100:00100000:2.0:1787387873.889337:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709733376 00000100:00100000:2.0:1787387873.889385:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709732992 00000100:00100000:2.0:1787387873.889388:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709732992 00000100:00100000:2.0:1787387873.889400:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709733120 00000100:00100000:2.0:1787387873.889402:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709733120 00000100:00100000:2.0:1787387873.889428:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787387873.889435:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709733376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387873.889472:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709733376:12345-0@lo:400:kworker.0 Request processed in 38us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387873.889478:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787387873.889491:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787387873.889496:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709732992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387873.889525:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709732992:12345-0@lo:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387873.889530:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787387873.889541:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787387873.889547:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709733120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387873.889574:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709733120:12345-0@lo:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387873.889579:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1787387873.889599:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387873.889616:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437fdbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709733120:0@lo:400:kworker.0 00000100:00100000:2.0:1787387873.889624:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437fdb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709732992:0@lo:400:kworker.0 00000100:00100000:1.0:1787387873.890622:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437fdbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709733376:0@lo:400:kworker.0 00000100:00100000:3.0:1787387873.892485:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709732736 00000100:00100000:3.0:1787387873.892503:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709732736 00000100:00100000:3.0:1787387873.892664:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787387873.892675:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709732736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387873.892834:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709732736:12345-0@lo:400:kworker.0 Request processed in 160us (6655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387873.892842:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787387873.892951:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437fdb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709732736:0@lo:400:kworker.0 00010000:00010000:3.0:1787387874.655919:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387874.911890:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387874.911915:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709733504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387874.911990:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387874.912189:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709733504 00000100:00100000:2.0:1787387874.912210:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709733504 00000100:00100000:2.0:1787387874.912265:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787387874.912274:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709733504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387874.912313:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387874.912361:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709733504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387874.912368:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787387874.912585:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709733504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787387875.680296:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387875.753438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387875.753486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387875.753537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387875.753632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387875.753692:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690876416 00000100:00100000:3.0:1787387875.753703:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690876416 00000100:00100000:3.0:1787387875.753801:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:3.0:1787387875.753812:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:2353:x1874211690876416:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387875.753899:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:2353:x1874211690876416:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 89us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387875.753923:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00080000:3.0:1787387875.753948:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387875.754417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387875.755086:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690876800 00000100:00100000:3.0:1787387875.755165:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690876800 00000100:00100000:3.0:1787387875.755227:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:3.0:1787387875.755235:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2353:x1874211690876800:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387875.755304:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2353:x1874211690876800:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 69us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387875.755312:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00080000:2.0:1787387875.756393:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387875.762817:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690876672 00000100:00100000:1.0:1787387875.762839:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690876672 00000100:00100000:1.0:1787387875.762913:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690876544 00000100:00100000:1.0:1787387875.762917:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690876544 00000100:00100000:1.0:1787387875.762948:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:1.0:1787387875.762959:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690876672:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387875.763047:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2353:x1874211690876672:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 90us (9560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387875.763067:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:1.0:1787387875.763086:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:1.0:1787387875.763095:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2353:x1874211690876544:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387875.763122:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2353:x1874211690876544:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (9490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387875.763128:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00080000:1.0:1787387875.763153:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387875.763157:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387875.764659:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690876288 00000100:00100000:0.0:1787387875.764673:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690876288 00000100:00100000:0.0:1787387875.764730:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 307 00000100:00100000:0.0:1787387875.764761:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2353:x1874211690876288:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387875.764844:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2353:x1874211690876288:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 105us (11306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387875.764851:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 307 00000100:00100000:1.0:1787387876.347383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387876.348411:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690876928 00000100:00100000:3.0:1787387876.348443:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690876928 00000100:00100000:3.0:1787387876.348513:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 238 00000100:00100000:3.0:1787387876.348524:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11282:x1874211690876928:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787387876.348632:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11282:x1874211690876928:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 Request processed in 109us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387876.348640:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 238 00000100:00100000:3.0:1787387876.357866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387876.358031:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690877184 00000100:00100000:0.0:1787387876.358043:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690877184 00000100:00100000:0.0:1787387876.358110:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:0.0:1787387876.358121:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:11282:x1874211690877184:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787387876.358837:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:11282:x1874211690877184:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 715us (990us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787387876.358846:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:1.0:1787387876.607938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387876.608109:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690877312 00000100:00100000:3.0:1787387876.608120:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690877312 00000100:00100000:3.0:1787387876.608232:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 239 00000100:00100000:3.0:1787387876.608244:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:12089:x1874211690877312:12345-192.168.204.59@tcp:101:lsof.0 00010000:00010000:3.0:1787387876.608266:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387876.608347:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c8612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52be4 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387876.608431:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8619 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387876.608445:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387876.608460:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387876.609278:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787387876.609286:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387876.609466:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387876.609504:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b000/0x93d41aeaa23c8612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52be4 expref: 7 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387876.611154:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8619 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52be4 expref: 6 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387876.611663:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:3.0:1787387876.611667:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387876.611672:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a000, rc 0) 00000100:00100000:3.0:1787387876.611842:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:12089:x1874211690877312:12345-192.168.204.59@tcp:101:lsof.0 Request processed in 3597us (3911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387876.611851:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 239 00010000:00010000:2.0:1787387876.702159:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787387877.534807:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787387877.534832:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787387877.534976:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787387877.534988:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1787387877.726956:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387878.749981:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787387878.878800:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387878.878812:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787387878.879371:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1787387878.879381:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787387879.006454:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387879.006483:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709733632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387879.006557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387879.006681:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709733632 00000100:00100000:2.0:1787387879.006690:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709733632 00000100:00100000:2.0:1787387879.006782:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787387879.006793:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709733632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787387879.006830:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387879.006883:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709733632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387879.006919:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787387879.006971:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709733632:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787387879.007146:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787387879.007483:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709733760:0@lo:400:kworker.0 00000100:00100000:1.0:1787387879.007527:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387879.007560:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709734272:0@lo:400:kworker.0 00000100:00100000:1.0:1787387879.007588:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387879.007608:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387879.007614:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4346458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709733888:0@lo:400:kworker.0 00000100:00100000:1.0:1787387879.007648:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387879.007680:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709734272 00000100:00100000:1.0:1787387879.007686:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709734272 00000100:00100000:1.0:1787387879.007735:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709733888 00000100:00100000:1.0:1787387879.007761:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709733888 00000100:00100000:1.0:1787387879.007783:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787387879.007789:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709734272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387879.007833:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709734272:12345-0@lo:400:kworker.0 Request processed in 43us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387879.007839:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787387879.007854:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787387879.007860:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709733888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387879.007886:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709733888:12345-0@lo:400:kworker.0 Request processed in 27us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387879.007892:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:1.0:1787387879.007927:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387879.007948:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4346458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709733888:0@lo:400:kworker.0 00000100:00100000:1.0:1787387879.007960:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709734272:0@lo:400:kworker.0 00000100:00100000:0.0:1787387879.008452:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4372012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709734144:0@lo:400:kworker.0 00000100:00100000:0.0:1787387879.008494:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387879.008527:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387879.008534:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4350d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709734016:0@lo:400:kworker.0 00000100:00100000:0.0:1787387879.008562:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387879.008591:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709734016 00000100:00100000:0.0:1787387879.008596:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709734016 00000100:00100000:0.0:1787387879.008634:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787387879.008641:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709734016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387879.008678:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709734016:12345-0@lo:400:kworker.0 Request processed in 38us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387879.008685:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1787387879.008705:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387879.008778:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4350d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709734016:0@lo:400:kworker.0 00000100:00100000:3.0:1787387879.008869:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709733760 00000100:00100000:3.0:1787387879.008874:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709733760 00000100:00100000:3.0:1787387879.008921:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787387879.008929:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709733760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387879.008971:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3311:x1874211709733760:12345-0@lo:400:kworker.0 Request processed in 43us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387879.008986:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787387879.009031:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3311:1874211709733760:0@lo:400:kworker.0 00000100:00100000:1.0:1787387879.011308:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709734144 00000100:00100000:1.0:1787387879.011332:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709734144 00000100:00100000:1.0:1787387879.011428:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787387879.011440:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709734144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387879.011535:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709734144:12345-0@lo:400:kworker.0 Request processed in 98us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387879.011544:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1787387879.013109:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387879.013173:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4372012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709734144:0@lo:400:kworker.0 00010000:00010000:2.0:1787387879.774497:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387880.029996:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709734400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387880.030077:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387880.038365:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709734400 00000100:00100000:3.0:1787387880.038382:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709734400 00000100:00100000:3.0:1787387880.041115:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787387880.041136:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709734400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787387880.041178:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387880.041271:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709734400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (11193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387880.041288:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787387880.041405:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709734400:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787387880.407377:0:12696:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:37:58 (1787387878) 00010000:00010000:1.0:1787387880.802422:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387880.877198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387880.877242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387880.877265:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690877440 00000100:00100000:3.0:1787387880.877286:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690877440 00000100:00100000:1.0:1787387880.877287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387880.877316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387880.877345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387880.877351:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 309 00000100:00100000:3.0:1787387880.877364:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2351:x1874211690877440:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387880.877375:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690877696 00000100:00100000:1.0:1787387880.877380:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690877696 00000100:00100000:1.0:1787387880.877422:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690877824 00000100:00100000:1.0:1787387880.877426:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690877824 00000100:00100000:3.0:1787387880.877439:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2351:x1874211690877440:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 77us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387880.877449:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 309 00000100:00100000:1.0:1787387880.877454:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:1.0:1787387880.877463:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437fdb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2351:x1874211690877696:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387880.877498:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437fdb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2351:x1874211690877696:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 37us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387880.877505:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:1.0:1787387880.877521:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:1.0:1787387880.877529:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a2d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2351:x1874211690877824:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387880.877554:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a2d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2351:x1874211690877824:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387880.877560:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:1.0:1787387880.877580:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690877952 00000100:00100000:1.0:1787387880.877583:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690877952 00000100:00100000:1.0:1787387880.877612:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690877568 00000100:00100000:1.0:1787387880.877615:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690877568 00000100:00100000:3.0:1787387880.877623:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:3.0:1787387880.877633:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4346458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:2351:x1874211690877952:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387880.877642:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:1.0:1787387880.877651:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:2351:x1874211690877568:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387880.877675:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4346458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:2351:x1874211690877952:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 42us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387880.877696:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:1.0:1787387880.877704:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:2351:x1874211690877568:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 53us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387880.877711:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00080000:1.0:1787387880.877761:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787387880.877767:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387880.877769:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787387881.822268:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387882.848383:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387883.871069:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387884.127772:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4374174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709734656:0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.127848:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387884.127905:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709735168:0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.127932:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387884.127967:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787387884.127973:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437f6c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709734528:0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128005:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387884.128028:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709735040:0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128051:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387884.128097:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709734784:0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128123:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387884.128224:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387884.128231:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709734912:0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128277:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387884.128325:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709735168 00000100:00100000:3.0:1787387884.128335:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709735168 00000100:00100000:3.0:1787387884.128391:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709734912 00000100:00100000:3.0:1787387884.128395:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709734912 00000100:00100000:3.0:1787387884.128419:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787387884.128428:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709735168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128482:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709735168:12345-0@lo:400:kworker.0 Request processed in 55us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387884.128490:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787387884.128507:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787387884.128513:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709734912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128546:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709734912:12345-0@lo:400:kworker.0 Request processed in 33us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387884.128552:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787387884.128569:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709734528 00000100:00100000:3.0:1787387884.128573:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709734528 00000100:00100000:3.0:1787387884.128598:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787387884.128604:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709734528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128633:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3314:x1874211709734528:12345-0@lo:400:kworker.0 Request processed in 29us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387884.128639:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787387884.128666:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709734656 00000100:00100000:3.0:1787387884.128677:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709734656 00000100:00100000:3.0:1787387884.128703:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787387884.128709:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709734656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128773:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874211709734656:12345-0@lo:400:kworker.0 Request processed in 63us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387884.128779:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787387884.128789:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709735040 00000100:00100000:3.0:1787387884.128792:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709735040 00000100:00100000:3.0:1787387884.128806:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709734784 00000100:00100000:3.0:1787387884.128809:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709734784 00000100:00100000:3.0:1787387884.128824:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787387884.128830:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709735040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128860:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709735040:12345-0@lo:400:kworker.0 Request processed in 30us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387884.128867:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787387884.128879:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787387884.128885:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709734784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128914:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709734784:12345-0@lo:400:kworker.0 Request processed in 29us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387884.128920:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787387884.128961:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709734912:0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128971:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709734784:0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.128995:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437f6c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3314:1874211709734528:0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.129004:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709735040:0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.129013:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4374174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874211709734656:0@lo:400:kworker.0 00000100:00100000:3.0:1787387884.129034:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709735168:0@lo:400:kworker.0 00000100:00080000:1.0:1787387884.130180:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787387884.130187:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387884.130189:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387884.130452:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387884.130471:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709735296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387884.130526:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387884.130614:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709735296 00000100:00100000:2.0:1787387884.130620:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709735296 00000100:00100000:2.0:1787387884.130669:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787387884.130678:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709735296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787387884.130711:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387884.130795:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709735296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387884.130802:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787387884.130917:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43720a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709735296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387884.497524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387884.497623:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690878208 00000100:00100000:0.0:1787387884.497634:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690878208 00000100:00100000:0.0:1787387884.497713:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:0.0:1787387884.497723:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+18:12310:x1874211690878208:12345-192.168.204.59@tcp:35:umount.0 00000100:00080000:1.0:1787387884.498243:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387884.498333:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:12310:x1874211690878208:12345-192.168.204.59@tcp:35:umount.0 Request processed in 609us (818us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787387884.498342:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:3.0:1787387884.501596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387884.501679:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690878464 00000100:00100000:2.0:1787387884.501690:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690878464 00000100:00100000:2.0:1787387884.501785:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:2.0:1787387884.501796:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+19:12310:x1874211690878464:12345-192.168.204.59@tcp:35:umount.0 00000100:00100000:2.0:1787387884.502295:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:12310:x1874211690878464:12345-192.168.204.59@tcp:35:umount.0 Request processed in 498us (705us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787387884.502303:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:3.0:1787387884.508303:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387884.509688:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690878720 00000100:00100000:2.0:1787387884.509701:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690878720 00000100:00100000:2.0:1787387884.509816:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:2.0:1787387884.509827:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d436567ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+20:12310:x1874211690878720:12345-192.168.204.59@tcp:35:umount.0 00000100:00100000:2.0:1787387884.510399:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d436567ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:12310:x1874211690878720:12345-192.168.204.59@tcp:35:umount.0 Request processed in 571us (2103us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787387884.510416:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:3.0:1787387884.518870:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387884.520273:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690878976 00000100:00100000:2.0:1787387884.520289:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690878976 00000100:00100000:2.0:1787387884.520357:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:2.0:1787387884.520367:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437f6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+21:12310:x1874211690878976:12345-192.168.204.59@tcp:35:umount.0 00000100:00100000:2.0:1787387884.521189:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437f6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:12310:x1874211690878976:12345-192.168.204.59@tcp:35:umount.0 Request processed in 815us (2321us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787387884.521199:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:1.0:1787387884.526146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387884.526210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387884.526370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387884.528161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387884.531144:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690879488 00000100:00100000:1.0:1787387884.531160:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690879488 00000100:00100000:1.0:1787387884.531488:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:1.0:1787387884.531499:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2349:x1874211690879488:12345-192.168.204.59@tcp:9:umount.0 00000020:00000080:1.0:1787387884.531540:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7969 00000100:00080000:1.0:1787387884.531550:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d437a71b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787387884.531592:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787387884.531929:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7138a1c-1444-4499-9235-7f89dd5ceb0b+2:2349:x1874211690879488:12345-192.168.204.59@tcp:9:umount.0 Request processed in 430us (3774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387884.531938:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00080000:1.0:1787387884.531963:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787387884.531996:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387884.534768:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690879104 00000100:00100000:0.0:1787387884.534789:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690879104 00000100:00100000:0.0:1787387884.534865:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690879232 00000100:00100000:0.0:1787387884.534869:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690879232 00000100:00100000:0.0:1787387884.534895:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690879360 00000100:00100000:0.0:1787387884.534898:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690879360 00000100:00100000:0.0:1787387884.534921:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:0.0:1787387884.534930:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+15:2353:x1874211690879104:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387884.534947:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387884.534968:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c7691 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5276f expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.534986:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387884.535047:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+14:2353:x1874211690879104:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 118us (8911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387884.535067:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:0.0:1787387884.535086:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:0.0:1787387884.535093:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43608e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+13:2350:x1874211690879232:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387884.535100:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387884.535122:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f91600/0x93d41aeaa23c75f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52737 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.535132:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387884.535152:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43608e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:2350:x1874211690879232:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 60us (8951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387884.535158:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:0.0:1787387884.535170:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:0.0:1787387884.535176:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:2352:x1874211690879360:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387884.535185:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387884.535193:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c787b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5283a expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.535212:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387884.535230:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2352:x1874211690879360:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 54us (8860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387884.535236:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:1.0:1787387884.544042:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387884.556966:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690879872 00000100:00100000:2.0:1787387884.556985:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690879872 00000100:00080000:1.0:1787387884.557179:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387884.557267:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:2.0:1787387884.557280:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2349:x1874211690879872:12345-192.168.204.59@tcp:9:umount.0 00000020:00000080:2.0:1787387884.557424:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7bd1 00000020:00010000:2.0:1787387884.557432:0:6605:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d43518e5800: total 0 00000100:00080000:2.0:1787387884.557436:0:6605:0:(import.c:65:import_set_state_nolock()) ffff8d43518e4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787387884.557647:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787387884.558013:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7138a1c-1444-4499-9235-7f89dd5ceb0b+5:2349:x1874211690879872:12345-192.168.204.59@tcp:9:umount.0 Request processed in 733us (13977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387884.558022:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 73 00000020:00010000:0.0:1787387884.558091:0:11539:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d43518e5800: total 0 00010000:00010000:0.0:1787387884.558221:0:11539:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d43518e5800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787387884.558283:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0fc8102/0x93d41aeaa23c7f6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a0f expref: 4 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.558497:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c860b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bdd expref: 3 pid: 6606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.558713:0:11539:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d43518e5800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787387884.558790:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387884.558793:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387884.558795:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387884.588902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387884.589666:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690880896 00000100:00100000:3.0:1787387884.589677:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690880896 00000100:00100000:3.0:1787387884.589795:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 240 00000100:00100000:3.0:1787387884.589806:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+22:2349:x1874211690880896:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:3.0:1787387884.589840:0:6840:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7605 00000020:00010000:3.0:1787387884.589856:0:6840:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d437a719000: total 0 00000100:00080000:3.0:1787387884.589861:0:6840:0:(import.c:65:import_set_state_nolock()) ffff8d437a718800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787387884.589886:0:6840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1787387884.590248:0:5796:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d437a719000: total 0 00010000:00010000:0.0:1787387884.590309:0:5796:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d437a719000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787387884.590348:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387884.590352:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387884.590360:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71800/0x93d41aeaa23c7f2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529fa expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590380:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:0.0:1787387884.590382:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387884.590386:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fc200/0x93d41aeaa23c85cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bc8 expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590400:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:0.0:1787387884.590402:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787387884.590405:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fd200/0x93d41aeaa23c7fcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a2b expref: 20 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590417:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720900) 00010000:00010000:0.0:1787387884.590433:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387884.590438:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad5a00/0x93d41aeaa23c78eb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b5284f expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590460:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:0.0:1787387884.590462:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787387884.590466:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c7c2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52936 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590476:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d436f2f6f00) 00010000:00010000:0.0:1787387884.590479:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787387884.590481:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c78cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52848 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590496:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387884.590499:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787387884.590502:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c7f58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a08 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590513:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:0.0:1787387884.590515:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787387884.590519:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a200/0x93d41aeaa23c82ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b04 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590532:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:0.0:1787387884.590534:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787387884.590538:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b600/0x93d41aeaa23c85f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bd6 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590564:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d4343c46700) 00010000:00010000:0.0:1787387884.590566:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787387884.590571:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90600/0x93d41aeaa23c84ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52b90 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590586:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d4358720700) 00010000:00010000:0.0:1787387884.590588:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787387884.590591:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4c00/0x93d41aeaa23c7feb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52a32 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590606:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d4343c46300) 00010000:00010000:0.0:1787387884.590608:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787387884.590612:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d43413fde00/0x93d41aeaa23c7e4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b529c2 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590626:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d4343c46f00) 00010000:00010000:0.0:1787387884.590628:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787387884.590632:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c793f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52864 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.590644:0:5796:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d437a719000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787387884.590659:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387884.590661:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387884.590663:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387884.593732:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7138a1c-1444-4499-9235-7f89dd5ceb0b+7:2349:x1874211690880896:12345-192.168.204.59@tcp:39:umount.0 Request processed in 3912us (4824us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787387884.593767:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 240 00010000:00010000:1.0:1787387884.894104:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387885.150059:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387885.150102:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709735424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387885.150177:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387885.150328:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709735424 00000100:00100000:2.0:1787387885.150337:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709735424 00000100:00100000:2.0:1787387885.150385:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787387885.150394:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709735424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387885.150429:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387885.150488:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709735424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387885.150524:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787387885.151065:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709735424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387885.918431:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387885.997505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387885.997567:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387885.997714:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690881024 00000100:00100000:3.0:1787387885.997725:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690881024 00000100:00100000:3.0:1787387885.997814:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 311 00000100:00100000:3.0:1787387885.997824:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2353:x1874211690881024:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387885.997907:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2353:x1874211690881024:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 84us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387885.997930:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 311 00000100:00100000:2.0:1787387885.999458:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690881152 00000100:00100000:2.0:1787387885.999471:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690881152 00000100:00100000:2.0:1787387885.999559:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:2.0:1787387885.999569:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:2353:x1874211690881152:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387885.999646:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:2353:x1874211690881152:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 78us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387885.999653:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00080000:3.0:1787387886.000622:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387886.851972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387886.852039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387886.852057:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690881280 00000100:00100000:0.0:1787387886.852067:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690881280 00000100:00100000:1.0:1787387886.852081:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387886.852130:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690881536 00000100:00100000:0.0:1787387886.852134:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690881536 00000100:00100000:1.0:1787387886.852136:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690881408 00000100:00100000:1.0:1787387886.852140:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690881408 00000100:00100000:0.0:1787387886.852168:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:0.0:1787387886.852228:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+12:2353:x1874211690881280:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387886.852245:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387886.852265:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c76d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52784 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387886.852285:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387886.852343:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:2353:x1874211690881280:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 118us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387886.855127:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:1.0:1787387886.855166:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a822300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:2353:x1874211690881536:12345-192.168.204.59@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787387886.855732:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:3.0:1787387886.855758:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:76cb2ca2-9623-47c7-b3c7-b630f764b01d+11:2353:x1874211690881408:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387886.855772:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387886.855795:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340030c00/0x93d41aeaa23c76de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b527ae expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387886.855813:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387886.855872:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:76cb2ca2-9623-47c7-b3c7-b630f764b01d+10:2353:x1874211690881408:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 119us (3790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387886.855880:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00010000:00010000:1.0:1787387886.856705:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387886.856726:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad5400/0x93d41aeaa23c7874 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52833 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387886.856756:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387886.856798:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a822300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76cb2ca2-9623-47c7-b3c7-b630f764b01d+8:2353:x1874211690881536:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1656us (4758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387886.856807:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:1.0:1787387886.864494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387886.864575:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690881792 00000100:00100000:3.0:1787387886.864584:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690881792 00000100:00100000:3.0:1787387886.864644:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 241 00000100:00100000:3.0:1787387886.864654:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+6:2349:x1874211690881792:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:3.0:1787387886.864698:0:5809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c76ec 00000020:00010000:3.0:1787387886.864707:0:5809:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d437a1ba000: total 0 00000100:00080000:3.0:1787387886.864712:0:5809:0:(import.c:65:import_set_state_nolock()) ffff8d437a1bf800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787387886.864765:0:5809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1787387886.864998:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130c956a-3dfa-4a85-a4d5-15465fdee9cd+5:2349:x1874211690881792:12345-192.168.204.59@tcp:39:umount.0 Request processed in 345us (513us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787387886.865006:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 241 00000020:00010000:1.0:1787387886.865623:0:5796:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d437a1ba000: total 0 00010000:00010000:1.0:1787387886.865629:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387886.865673:0:5796:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d437a1ba000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787387886.865707:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:1.0:1787387886.865711:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787387886.865720:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460a000/0x93d41aeaa23c8619 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52be4 expref: 4 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387886.865784:0:5796:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d437a1ba000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787387886.865796:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387886.865798:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387886.865800:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387886.870192:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1787387886.912167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387886.912249:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690882048 00000100:00100000:0.0:1787387886.912259:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690882048 00000100:00100000:0.0:1787387886.912323:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 312 00000100:00100000:0.0:1787387886.912334:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43451fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+7:2349:x1874211690882048:12345-192.168.204.59@tcp:251:umount.0 00000020:00000080:0.0:1787387886.912378:0:5800:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c75e2 00000020:00010000:0.0:1787387886.912390:0:5800:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d42411a6800: total 0 00000100:00080000:0.0:1787387886.912395:0:5800:0:(import.c:65:import_set_state_nolock()) ffff8d42411a7800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787387886.912477:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43451fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76cb2ca2-9623-47c7-b3c7-b630f764b01d+3:2349:x1874211690882048:12345-192.168.204.59@tcp:251:umount.0 Request processed in 144us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387886.912485:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 312 00000020:00010000:1.0:1787387886.912933:0:5795:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d42411a6800: total 0 00010000:00010000:1.0:1787387886.913145:0:5795:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d42411a6800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787387886.913196:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340031e00/0x93d41aeaa23c7698 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52776 expref: 2 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387886.913214:0:5795:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d42411a6800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787387886.913225:0:5795:0:(genops.c:906:class_export_put()) final put ffff8d42411a6800/76cb2ca2-9623-47c7-b3c7-b630f764b01d 00010000:00010000:1.0:1787387886.913245:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387886.913247:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387886.913249:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787387886.916505:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d42411a6800/76cb2ca2-9623-47c7-b3c7-b630f764b01d for MGS 00000020:00000080:2.0:1787387886.916577:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d42411a7800 for MGS 00010000:00010000:0.0:1787387886.941929:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787387887.290508:0:7514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000020:00000080:0.0:1787387887.290517:0:7514:0:(genops.c:906:class_export_put()) final put ffff8d437a71e000/d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000020:00000080:3.0:1787387887.290874:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d437a71e000/d7138a1c-1444-4499-9235-7f89dd5ceb0b for lustre-OST0001 00000020:00000080:3.0:1787387887.290915:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d437a71b000 for lustre-OST0001 00000001:00080000:1.0:1787387887.792112:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000001:00080000:1.0:1787387887.794316:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1787387887.798992:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 130c956a-3dfa-4a85-a4d5-15465fdee9cd 00000001:00080000:0.0:1787387887.799022:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787387887.799545:0:5829:0:(genops.c:906:class_export_put()) final put ffff8d437a1ba000/130c956a-3dfa-4a85-a4d5-15465fdee9cd 00000001:00100000:0.0:1787387887.800719:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000001:00080000:0.0:1787387887.800734:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1787387887.800758:0:5829:0:(genops.c:906:class_export_put()) final put ffff8d437a719000/d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000020:00000080:1.0:1787387887.804606:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d437a1ba000/130c956a-3dfa-4a85-a4d5-15465fdee9cd for lustre-MDT0000 00000020:00000080:1.0:1787387887.804775:0:474:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d437a1bf800 for lustre-MDT0000 00000020:00000080:1.0:1787387887.807015:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d437a719000/d7138a1c-1444-4499-9235-7f89dd5ceb0b for lustre-MDT0000 00000020:00000080:1.0:1787387887.807104:0:474:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d437a718800 for lustre-MDT0000 00010000:00010000:1.0:1787387887.972174:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787387888.094991:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387888.095005:0:11557:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787387888.096553:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787387888.096573:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:0.0:1787387888.317798:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000020:00000080:0.0:1787387888.317806:0:6629:0:(genops.c:906:class_export_put()) final put ffff8d43518e5800/d7138a1c-1444-4499-9235-7f89dd5ceb0b 00000020:00000080:1.0:1787387888.321445:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43518e5800/d7138a1c-1444-4499-9235-7f89dd5ceb0b for lustre-OST0000 00000020:00000080:1.0:1787387888.321521:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d43518e4800 for lustre-OST0000 00000020:01000004:1.0:1787387888.987468:0:12896:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:1.0:1787387888.991099:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787387889.018219:0:12896:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787387889.018271:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387889.018284:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387889.018292:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387889.018298:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387889.018321:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787387889.018340:0:12896:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787387889.018366:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787387889.018370:0:12896:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787387889.018376:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787387889.018401:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8d436f1b6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787387889.018514:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387889.018522:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.018530:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5600 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387889.018534:0:11539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.018543:0:11539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387889.018551:0:11539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387889.018556:0:11539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787387889.018558:0:11539:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787387889.018561:0:11539:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787387889.018587:0:11539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.018594:0:11539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387889.018619:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.018627:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4342ad5600/0x93d41aeaa23c7667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c766e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.018645:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387889.018647:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387889.018649:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387889.018667:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709735680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387889.018734:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387889.018778:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874211709735552:0@lo:39:umount.0 00000100:00100000:1.0:1787387889.018812:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387889.019357:0:11042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709735680 00000100:00100000:3.0:1787387889.019366:0:11042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709735680 00000100:00100000:3.0:1787387889.019514:0:11042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387889.019525:0:11042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3313:x1874211709735680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787387889.019540:0:11042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387889.019556:0:11042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f91c00/0x93d41aeaa23c766e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c7667 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387889.019570:0:11042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387889.019623:0:11042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:3313:x1874211709735680:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387889.019631:0:11042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787387889.019721:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709735680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387889.019912:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709735552 00000100:00100000:1.0:1787387889.019917:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709735552 00000100:00100000:1.0:1787387889.019951:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787387889.019957:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874211709735552:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787387889.019980:0:5807:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c73ff 00000100:00080000:1.0:1787387889.019988:0:5807:0:(import.c:65:import_set_state_nolock()) ffff8d437428d800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787387889.020036:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1874211709735552:12345-0@lo:39:umount.0 Request processed in 79us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387889.020042:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787387889.020049:0:5807:0:(genops.c:906:class_export_put()) final put ffff8d4374288000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787387889.020070:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787387889.020078:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4374288000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787387889.020134:0:474:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d437428d800 for lustre-MDT0000 00000100:00080000:0.0:1787387889.025102:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d436f1b6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787387889.025132:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874211709735552:0@lo:39:umount.0 00000100:00080000:0.0:1787387889.025181:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787387889.025186:0:12896:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787387889.025190:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787387889.026188:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026204:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026211:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026218:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026239:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787387889.026244:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026268:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026274:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026280:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026295:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787387889.026308:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387889.026313:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026320:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90000 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387889.026324:0:11539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026332:0:11539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387889.026339:0:11539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387889.026345:0:11539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787387889.026348:0:11539:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787387889.026377:0:11539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026392:0:11539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387889.026421:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026427:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4242f90000/0x93d41aeaa23c7675 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c767c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026439:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387889.026442:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026447:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030800 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387889.026450:0:11539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026457:0:11539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387889.026463:0:11539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387889.026468:0:11539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787387889.026470:0:11539:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787387889.026472:0:11539:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787387889.026487:0:11539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026493:0:11539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387889.026507:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026523:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4340030800/0x93d41aeaa23c759c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c75a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.026536:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387889.026537:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387889.026539:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387889.026539:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387889.026547:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387889.026547:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387889.026563:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709735936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387889.026563:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709735808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387889.031379:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387889.034537:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387889.034619:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.034633:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.034809:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.034816:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.034839:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787387889.034848:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fd400/0x93d41aeaa23c7350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.034854:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fd400/0x93d41aeaa23c7350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.034877:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fd400/0x93d41aeaa23c7350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.034884:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d43413fd400/0x93d41aeaa23c7350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.034960:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787387889.034966:0:12896:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787387889.034971:0:12896:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787387889.035009:0:12896:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787387889.035014:0:12896:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787387889.035018:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787387889.035024:0:12896:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787387889.035030:0:12896:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8d437a71d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787387889.035035:0:12896:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8d4377c94800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787387889.035039:0:12896:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8d435022b380) has exports, disconnecting them 00000020:00080000:0.0:1787387889.035043:0:12896:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d437a71d800), last request at 1787387884 00000020:00000080:0.0:1787387889.035050:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7564 00000100:00080000:0.0:1787387889.035109:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8d437a71c800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787387889.035165:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387889.035172:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.035180:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91e00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387889.035183:0:11539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.035191:0:11539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387889.035205:0:11539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387889.035211:0:11539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787387889.035214:0:11539:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787387889.035215:0:11539:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787387889.035249:0:11539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.035256:0:11539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387889.035274:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.035280:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4242f91e00/0x93d41aeaa23c789e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c78a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.035291:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387889.035295:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d43413fd400/0x93d41aeaa23c7350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.035300:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd400 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387889.035303:0:11539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fd400/0x93d41aeaa23c7350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.035309:0:11539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d43413fd400/0x93d41aeaa23c7350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387889.035315:0:11539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fd400/0x93d41aeaa23c7350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387889.035331:0:11539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787387889.035334:0:11539:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787387889.035335:0:11539:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787387889.035348:0:11539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d43413fd400/0x93d41aeaa23c7350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.035353:0:11539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387889.035366:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d43413fd400/0x93d41aeaa23c7350 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.035373:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d43413fd400/0x93d41aeaa23c7350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7357 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.035386:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387889.035388:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387889.035389:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387889.035406:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709736192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387889.035446:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387889.035487:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709735936 00000100:00100000:0.0:1787387889.035494:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709735936 00000100:00100000:0.0:1787387889.035537:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709735808 00000100:00100000:0.0:1787387889.035540:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709735808 00000100:00100000:0.0:1787387889.035552:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709736192 00000100:00100000:0.0:1787387889.035553:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709736192 00000100:00100000:0.0:1787387889.035567:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387889.035574:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a823800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+20:3312:x1874211709735936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387889.035586:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387889.035598:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f90e00/0x93d41aeaa23c75a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c759c expref: 20 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387889.035620:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387889.035812:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a823800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+19:3312:x1874211709735936:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (4515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387889.035819:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387889.035839:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787387889.035847:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:3313:x1874211709735808:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387889.035851:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1787387889.035858:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787387889.035865:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+18:3313:x1874211709736192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387889.035870:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c767c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c7675 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387889.035877:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387889.035881:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787387889.035891:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152f000/0x93d41aeaa23c7357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c7350 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387889.035905:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387889.035943:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+16:3313:x1874211709736192:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387889.035949:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1787387889.035966:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387889.035982:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709736064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387889.036009:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387889.036273:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:3313:x1874211709735808:12345-0@lo:103:ldlm_bl.0 Request processed in 426us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387889.036280:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787387889.036449:0:8324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709736064 00000100:00100000:2.0:1787387889.036456:0:8324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709736064 00000020:00080000:0.0:1787387889.036479:0:12896:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d437a71d800): rc 0 00000100:00100000:1.0:1787387889.036481:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709735936:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787387889.036487:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d437a71d800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:2.0:1787387889.036495:0:8324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000020:00080000:0.0:1787387889.036504:0:12896:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d4377c94800), last request at 1787387884 00000100:00100000:2.0:1787387889.036506:0:8324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+15:3312:x1874211709736064:12345-0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787387889.036512:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7499 00000020:00000080:1.0:1787387889.036516:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d437a71d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1787387889.036517:0:8324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1787387889.036523:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8d4377c95800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787387889.036529:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4377c70600/0x93d41aeaa23c78a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c789e expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387889.036540:0:8324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387889.036546:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787387889.036555:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d437a71c800 for lustre-MDT0000 00000020:00080000:0.0:1787387889.036556:0:12896:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d4377c94800): rc 0 00000020:00000080:0.0:1787387889.036560:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d4377c94800/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:2.0:1787387889.036573:0:8324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a+14:3312:x1874211709736064:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (562us total) trans 0 rc 0/0 00000020:00000080:1.0:1787387889.036577:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4377c94800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000004:00000080:0.0:1787387889.036577:0:12896:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb034c0d17ae0 00000100:00100000:2.0:1787387889.036581:0:8324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787387889.036597:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787387889.036601:0:12896:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000020:00000080:1.0:1787387889.036604:0:474:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4377c95800 for lustre-MDT0000 00000004:00080000:0.0:1787387889.036619:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787387889.036622:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709736064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387889.036646:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709736192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387889.036654:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709735808:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787387889.036761:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787387889.036783:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8d4373f2f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787387889.036801:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787387889.036805:0:12896:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787387889.036812:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787387889.036872:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787387889.036880:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8d42411a3000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787387889.036959:0:12896:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8d435022b380) has no exports 00000100:00100000:2.0:1787387889.037129:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709736320:0@lo:9:umount.0 00000100:00100000:2.0:1787387889.037166:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387889.037187:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709736448:0@lo:9:umount.0 00000100:00100000:2.0:1787387889.037208:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387889.038464:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387889.039171:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709736320 00000100:00100000:1.0:1787387889.039181:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709736320 00000100:00100000:1.0:1787387889.039240:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709736448 00000100:00100000:1.0:1787387889.039243:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709736448 00000100:00100000:1.0:1787387889.039265:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787387889.039275:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874211709736320:12345-0@lo:9:umount.0 00000100:00080000:0.0:1787387889.039280:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787387889.039286:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1787387889.039316:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c74e6 00000100:00080000:1.0:1787387889.039326:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d4242d48800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787387889.039366:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1787387889.039370:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387889.039701:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1874211709736320:12345-0@lo:9:umount.0 Request processed in 426us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387889.039709:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787387889.039722:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787387889.039729:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874211709736448:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787387889.039759:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c75cd 00000100:00080000:1.0:1787387889.039774:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d42411a2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787387889.039793:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787387889.039967:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1874211709736448:12345-0@lo:9:umount.0 Request processed in 238us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387889.039986:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1787387889.040007:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787387889.041698:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4373f2f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787387889.041729:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787387889.041731:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787387889.041756:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709736320:0@lo:9:umount.0 00000100:00080000:2.0:1787387889.041771:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d42411a3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787387889.041789:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787387889.041791:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787387889.041812:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709736448:0@lo:9:umount.0 00000020:00080000:0.0:1787387889.049268:0:12896:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8d435022b380) has no exports 00000020:00000080:0.0:1787387889.119655:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c73ab 00000020:00000080:0.0:1787387889.119678:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d437428d000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787387889.119977:0:12896:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787387889.120096:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787387889.120108:0:12896:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787387889.120121:0:12896:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8d434352cd40) has no exports 00000020:00000080:1.0:1787387889.120470:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c73a4 00000020:00000080:1.0:1787387889.120477:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d434505d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787387889.120662:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d437428d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787387889.121011:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d434505d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787387889.121082:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787387889.121090:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787387889.121094:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d434505e800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787387889.121097:0:12896:0:(genops.c:865:class_export_destroy()) destroying export ffff8d434505e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787387889.121104:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1787387889.121229:0:12896:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d434656e600 - data ffff8d4365a8bbd0/ffff8d43745e3000 00000020:01000000:1.0:1787387889.121358:0:12896:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d43438b4c00 - data ffff8d43658000d8/ffff8d4351c33800 00000001:00000004:1.0:1787387889.139169:0:12896:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787387889.238989:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787387889.238999:0:12896:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787387889.239025:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787387889.239027:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787387889.239358:0:6857:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787387889.239364:0:6857:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787387889.239373:0:6857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787387889.240271:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787387889.240276:0:12896:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787387889.240298:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787387889.240301:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787387889.240761:0:7816:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787387889.240766:0:7816:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787387889.240774:0:7816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000100:00100000:2.0:1787387889.261859:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709736576:0@lo:400:kworker.0 00000100:00100000:2.0:1787387889.261950:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387889.262506:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709736576 00000100:00100000:0.0:1787387889.262515:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709736576 00000100:00100000:0.0:1787387889.262566:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787387889.262574:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1874211709736576:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787387889.262583:0:5809:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787387889.262632:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1874211709736576:12345-0@lo:400:kworker.0 Request processed in 59us (683us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787387889.262639:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1787387889.263834:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787387889.263843:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8d4377f7b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787387889.263847:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787387889.265159:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709736704:0@lo:400:kworker.0 00000100:00100000:3.0:1787387889.265240:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387889.265530:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709736704 00000100:00100000:0.0:1787387889.265617:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709736704 00000100:00100000:0.0:1787387889.265661:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787387889.265678:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1874211709736704:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787387889.265686:0:5807:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787387889.265734:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43720a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1874211709736704:12345-0@lo:400:kworker.0 Request processed in 56us (494us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787387889.265758:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1787387889.273998:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8d4377f7b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787387889.274031:0:3314:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 163 00000100:00080000:2.0:1787387889.274046:0:3314:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d4377f7b800 using connection 192.168.204.159@tcp/0@lo 00000100:00080000:3.0:1787387889.274050:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787387889.274059:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8d4373f2e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787387889.274064:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787387889.274068:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8d4373f2e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787387889.274072:0:3311:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 185 00000100:00080000:3.0:1787387889.274079:0:3311:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d4373f2e800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1787387889.274136:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d43608e5180 x1874211709736832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787387889.274153:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437a748700 x1874211709736960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787387889.274175:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709736704:0@lo:400:kworker.0 00000100:00100000:2.0:1787387889.274175:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709736576:0@lo:400:kworker.0 00000100:00100000:3.0:1787387889.274250:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43608e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874211709736832:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787387889.274342:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387889.274399:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874211709736960:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787387889.274421:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387889.274455:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709736832 00000100:00100000:3.0:1787387889.274462:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709736832 00000100:00100000:3.0:1787387889.274499:0:6840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709736960 00000100:00100000:3.0:1787387889.274501:0:6840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709736960 00000100:00100000:3.0:1787387889.274520:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787387889.274529:0:6840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1874211709736832:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1787387889.274550:0:6840:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787387889.274569:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787387889.274577:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874211709736960:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787387889.274587:0:5809:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787387889.274638:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874211709736960:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 59us (216us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787387889.274646:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787387889.293952:0:6840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1874211709736832:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 19413us (19600us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787387889.293967:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1787387889.294804:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4373f2e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787387889.294812:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787387889.294817:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43608e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874211709736832:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787387889.294831:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4377f7b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787387889.294835:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787387889.294838:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874211709736960:0@lo:38:ptlrpcd_00_03.0 00000020:00000080:2.0:1787387889.322521:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7373 00000020:00000080:2.0:1787387889.322534:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d4381c3d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787387889.322853:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4381c3d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787387889.326643:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7388 00000020:00000080:2.0:1787387889.326658:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d43747dd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787387889.327216:0:12896:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787387889.327229:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787387889.327239:0:12896:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787387889.327243:0:12896:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8d43502299c0) has no exports 00000004:01000000:2.0:1787387889.327419:0:12896:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787387889.327428:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c75c6 00000020:00000080:2.0:1787387889.327433:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d437461d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787387889.328855:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43747dd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787387889.330433:0:12896:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787387889.330448:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787387889.330462:0:12896:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787387889.330467:0:12896:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8d4345183380) has no exports 00000020:00000080:2.0:1787387889.330477:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c75bf 00000020:00000080:2.0:1787387889.330485:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d42411a2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787387889.331582:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d437461d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787387889.331922:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d42411a2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787387889.332362:0:12896:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787387889.332367:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787387889.332371:0:12896:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787387889.332377:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787387889.332379:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787387889.332428:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787387889.332440:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787387889.332462:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c74df 00000020:00000080:2.0:1787387889.332470:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d4377f7e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787387889.332476:0:12896:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787387889.332480:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787387889.332485:0:12896:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787387889.332488:0:12896:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8d4242c98000) has no exports 00000020:00000080:2.0:1787387889.332495:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c74d8 00000020:00000080:2.0:1787387889.332499:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d43747db000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787387889.332918:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d42411a3000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787387889.332924:0:8:0:(genops.c:906:class_export_put()) final put ffff8d4377f79800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787387889.332927:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4377f79800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787387889.332932:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:01000000:2.0:1787387889.333135:0:12896:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787387889.333139:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787387889.333141:0:12896:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787387889.333145:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787387889.333146:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787387889.333187:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787387889.333193:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787387889.333225:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787387889.333229:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787387889.333232:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d4381c39800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787387889.333234:0:12896:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4381c39800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787387889.333239:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787387889.333888:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4377f7e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787387889.333897:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43747db000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787387889.333906:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4373f2f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787387889.333910:0:8:0:(genops.c:906:class_export_put()) final put ffff8d4377c91800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787387889.333913:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4377c91800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787387889.333917:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787387889.334376:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c738f 00000020:00000080:2.0:1787387889.334383:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d43747dc000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787387889.334403:0:12896:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787387889.334409:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787387889.334415:0:12896:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787387889.334418:0:12896:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8d43747d3380) has no exports 00000020:00000080:1.0:1787387889.334436:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43747dc000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787387889.334441:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787387889.334446:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787387889.334449:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d4381c3b000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787387889.334452:0:12896:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4381c3b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787387889.334461:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787387889.334625:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7396 00000020:00000080:2.0:1787387889.334630:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d43747da800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787387889.334761:0:12896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4350ce4000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787387889.334765:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4350ce4000 3 00000020:01000004:2.0:1787387889.334827:0:12896:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d4350ce4000 from lustre-MDT0000 00000020:00000080:2.0:1787387889.334848:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787387889.334852:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787387889.334855:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d4381c3c000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787387889.334857:0:12896:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4381c3c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787387889.334863:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787387889.334890:0:12896:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787387889.334893:0:12896:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787387889.334895:0:12896:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787387889.334897:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787387889.334900:0:12896:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787387889.334906:0:12896:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8d43450a6800 2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787387889.334911:0:12896:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8d4350228000) has exports, disconnecting them 00000020:00080000:2.0:1787387889.334917:0:12896:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d43450a6800), last request at 1787387641 00000020:00000080:2.0:1787387889.334930:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7334 00000020:00010000:2.0:1787387889.334934:0:12896:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d43450a6800: total 1 00000100:00080000:2.0:1787387889.334938:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8d43450a6000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787387889.334959:0:12896:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d43450a6800): rc 0 00000020:00080000:2.0:1787387889.334964:0:12896:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8d4350228000) has no exports 00000020:00010000:3.0:1787387889.334965:0:5796:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d43450a6800: total 1 00010000:00010000:3.0:1787387889.335001:0:5796:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d43450a6800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787387889.335032:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad4200/0x93d41aeaa23c7889 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c7882 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387889.335052:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152ea00/0x93d41aeaa23c7897 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c7890 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387889.335068:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340030e00/0x93d41aeaa23c744c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c7445 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387889.335082:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad4600/0x93d41aeaa23c768a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c7683 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387889.335096:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4342ad5800/0x93d41aeaa23c7644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c763d expref: 5 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387889.335097:0:5801:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d43451f3800:5801] 1 exiting: rc = 0 00010000:00010000:3.0:1787387889.335139:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f91200/0x93d41aeaa23c7636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c762f expref: 4 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387889.335150:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340031600/0x93d41aeaa23c7652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c764b expref: 3 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387889.335161:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340031000/0x93d41aeaa23c7660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x93d41aeaa23c7659 expref: 2 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387889.335173:0:5796:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d43450a6800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787387889.335189:0:5796:0:(genops.c:906:class_export_put()) final put ffff8d43450a6800/2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a 00000100:00100000:0.0:1787387889.335258:0:5800:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d43451f2800:5800] 0 exiting: rc = 1 00010000:00010000:3.0:1787387889.335585:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387889.335589:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387889.335591:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787387889.335609:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43747da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787387889.335618:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43450a6800/2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a for MGS 00000020:00000080:1.0:1787387889.335641:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d43450a6000 for MGS 00000100:00100000:3.0:1787387889.335953:0:5802:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d4346469e00:5802] 2 exiting: rc = 0 00000100:00100000:1.0:1787387889.336264:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336275:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336281:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336287:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336293:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336307:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336312:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336322:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336328:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336334:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336341:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336346:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336353:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336358:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336364:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336376:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336382:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336388:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336394:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336399:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336406:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336412:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336417:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336422:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336428:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336433:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336439:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336445:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336451:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336456:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336462:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336467:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336472:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336478:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336483:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336489:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336494:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336499:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336504:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336509:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336521:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336531:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336537:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336544:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336549:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336555:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336560:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336565:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336570:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336575:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336580:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336587:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336592:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336597:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336602:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336607:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336611:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336616:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336621:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336626:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336630:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336635:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336640:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.336645:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787387889.337266:0:12896:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787387889.337269:0:12896:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787387889.338453:0:12896:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d434385bc00 - data ffff8d4352724af8/ffff8d4345d17800 00000020:01000000:1.0:1787387889.338549:0:12896:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d4350bfa4e0 - data ffff8d436db5b6c0/ffff8d43434dd000 00000020:00000080:1.0:1787387889.339467:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7318 00000020:00000080:1.0:1787387889.339475:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d4358461800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787387889.339548:0:12896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4350ce4000 from MGS, refs=2 00000020:01000004:1.0:1787387889.339552:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4350ce4000 2 00000020:01000004:1.0:1787387889.339555:0:12896:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d4350ce4000 from MGS 00000020:00000080:1.0:1787387889.339600:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787387889.339620:0:12896:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787387889.339624:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d4358464800/MGS 00000020:00000080:1.0:1787387889.339627:0:12896:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4358464800/MGS for MGS 00000020:01000000:1.0:1787387889.339635:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787387889.339715:0:12896:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787387889.339719:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787387889.339725:0:12896:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787387889.339731:0:12896:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d43747de800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787387889.339759:0:12896:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8d43747d4d40) has exports, disconnecting them 00000020:00080000:1.0:1787387889.339764:0:12896:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d43747de800), last request at 1787387642 00000020:00000080:1.0:1787387889.339958:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c73e3 00000020:00080000:1.0:1787387889.339977:0:12896:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d43747de800): rc 0 00000020:00000080:1.0:1787387889.339981:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d43747de800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787387889.340358:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4358461800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787387889.340889:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43747de800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787387889.341479:0:12896:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787387889.341485:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787387889.341490:0:12896:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787387889.341496:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787387889.341887:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787387889.341896:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787387889.341903:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4350ce4000 1 00000020:00000080:1.0:1787387889.341909:0:12896:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c730a 00000020:00000080:1.0:1787387889.341918:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d4358465800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787387889.342360:0:474:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d436f1b6800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787387889.342368:0:474:0:(genops.c:906:class_export_put()) final put ffff8d43747df800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787387889.342371:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43747df800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787387889.342376:0:474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1787387889.342468:0:12896:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787387889.342474:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787387889.342478:0:12896:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787387889.342482:0:12896:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8d435022cd40) has no exports 00000020:00000080:2.0:1787387889.344305:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4358465800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787387889.406709:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787387889.406724:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787387889.406730:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d4350ce1000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787387889.406734:0:12896:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4350ce1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787387889.406762:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787387889.406943:0:12896:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d4350ce5000 00000020:01000000:2.0:1787387889.406970:0:12896:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787387889.406974:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787387889.406979:0:12896:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787387889.406983:0:12896:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8d434352b380) has no exports 00000100:00100000:3.0:1787387889.407075:0:6840:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d4350395200:6840] 3 exiting: rc = 0 00000100:00100000:2.0:1787387889.407281:0:5809:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d4343540200:5809] 2 exiting: rc = 0 00000100:00100000:2.0:1787387889.407670:0:5808:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d4343541c00:5808] 1 exiting: rc = 0 00000100:00100000:2.0:1787387889.407722:0:5807:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d43464e7800:5807] 0 exiting: rc = 1 00000100:00100000:2.0:1787387889.407786:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407792:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407798:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407803:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407808:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407813:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407817:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407822:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407827:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407831:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407836:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407840:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407845:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407850:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407854:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407859:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407864:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407870:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407875:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407890:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407895:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407900:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407905:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407910:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407915:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407919:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407924:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407929:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407934:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407938:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407943:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407947:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407952:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407957:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407961:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407975:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407980:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407985:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407990:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407994:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.407998:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408003:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408009:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408019:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408024:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408029:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408034:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408038:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408043:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408048:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408053:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408058:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408063:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408068:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408080:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408087:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408092:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408098:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408104:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408118:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408124:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408132:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408140:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.408148:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.416138:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d4343540000:5811] 1 exiting: rc = 0 00000100:00100000:2.0:1787387889.416384:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d4343540600:5810] 0 exiting: rc = 1 00000100:00100000:0.0:1787387889.416488:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416498:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416505:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416511:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416518:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416523:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416529:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416535:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416557:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416564:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416570:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416577:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416583:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416589:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416594:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416599:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416604:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416608:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416614:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416619:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416624:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416629:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416634:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416640:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416645:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416650:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416656:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416660:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416665:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416669:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416674:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416680:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416685:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416691:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416696:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416701:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416706:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416711:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416716:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416721:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416726:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416732:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416974:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416987:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416992:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.416997:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417002:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417007:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417013:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417019:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417024:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417029:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417034:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417039:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417044:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417048:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417053:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417059:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417064:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417070:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417075:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417080:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417085:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.417092:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.418648:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d4343541a00:5812] 0 exiting: rc = 1 00000100:00100000:1.0:1787387889.418845:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d4343541200:5813] 1 exiting: rc = 0 00000100:00100000:0.0:1787387889.418947:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.418954:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.418960:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.418966:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.418971:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.418977:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.418983:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.418988:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.418993:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419010:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419017:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419024:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419032:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419037:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419053:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419059:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419066:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419071:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419078:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419084:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419089:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419118:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419125:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419131:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419136:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419142:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419148:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419154:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419159:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419165:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419174:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419179:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419185:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419206:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419213:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419220:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419225:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419233:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419239:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419245:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419251:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419257:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419263:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419268:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419275:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419294:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419301:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419308:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419315:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419328:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419334:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419339:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419548:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419557:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419563:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419568:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419574:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419592:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419598:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419606:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419611:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419617:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419622:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.419635:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.428228:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d4343540e00:5815] 1 exiting: rc = 0 00000100:00100000:2.0:1787387889.428420:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d4343541400:5814] 0 exiting: rc = 1 00000100:00100000:1.0:1787387889.428487:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428495:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428505:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428523:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428528:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428533:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428539:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428544:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428548:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428553:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428557:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428562:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428567:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428571:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428575:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428579:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428584:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428588:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428593:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428597:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428602:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428606:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428610:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428614:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428619:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428622:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428627:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428631:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428635:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428639:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428643:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428647:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428651:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428656:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428660:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428665:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428670:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428674:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428684:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428689:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428694:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428699:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428705:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428709:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428715:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428721:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428731:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428761:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428838:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428843:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428849:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428853:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428858:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428862:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428866:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428870:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428874:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428878:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428883:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428888:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428892:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428896:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428901:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.428906:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.429286:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d43451c0200:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1787387889.429443:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d43451eac00:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1787387889.429527:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429533:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429538:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429543:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429548:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429553:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429558:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429563:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429567:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429579:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429584:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429588:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429593:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429597:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429602:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429606:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429611:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429615:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429620:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429624:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429629:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429633:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429638:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429642:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429646:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429650:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429655:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429659:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429663:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429668:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429672:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429677:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429682:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429687:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429692:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429697:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429702:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429707:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429716:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429734:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429758:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429764:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429843:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429849:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429861:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429867:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429871:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429876:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429881:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429886:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429890:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429894:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429898:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429902:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429906:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429911:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429915:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429919:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429923:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429927:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429931:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429936:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429940:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387889.429944:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787387889.431389:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d43451c0000:5819] 1 exiting: rc = 0 00000100:00100000:1.0:1787387889.431521:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d43451c0600:5818] 0 exiting: rc = 1 00000100:00100000:0.0:1787387889.431635:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431641:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431646:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431651:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431657:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431661:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431666:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431671:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431675:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431680:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431684:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431688:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431693:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431698:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431703:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431707:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431712:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431716:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431729:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431733:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431888:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431895:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431899:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431904:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431908:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431913:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431917:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431922:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431926:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431931:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431935:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431940:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431944:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431948:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431953:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431958:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431962:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431976:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431980:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431985:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431989:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431993:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.431997:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432002:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432012:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432017:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432022:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432025:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432030:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432034:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432039:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432043:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432049:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432064:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432070:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432075:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432080:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432085:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432101:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432114:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432120:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432125:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432130:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432135:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.432727:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d43434f1800:5822] 2 exiting: rc = 0 00000100:00100000:2.0:1787387889.432815:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d43434f1a00:5820] 0 exiting: rc = 1 00000100:00100000:1.0:1787387889.432978:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d43451ea800:5821] 1 exiting: rc = 0 00000100:00100000:0.0:1787387889.433174:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433181:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433190:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433268:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433274:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433280:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433285:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433404:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433411:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433416:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433422:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433427:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433433:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433514:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433525:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433530:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433535:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433541:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433547:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433553:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433558:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433564:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433569:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433583:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433588:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433594:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433600:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433618:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433625:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433631:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433637:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433647:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433656:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433663:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433669:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433675:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433681:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433686:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433693:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433698:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433703:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433708:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433714:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433719:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433725:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433730:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433803:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433810:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433816:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433821:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433827:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433846:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433852:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433858:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433864:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433869:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433874:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433879:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433891:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433896:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433901:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433907:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433912:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387889.433917:0:12896:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787387889.440587:0:12896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787387889.440600:0:12896:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787387889.440606:0:12896:0:(genops.c:906:class_export_put()) final put ffff8d4360807800/MDS_uuid 00000020:00000080:0.0:1787387889.440611:0:12896:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4360807800/MDS_uuid for MDS 00000020:01000000:0.0:1787387889.440619:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787387889.440877:0:12896:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787387890.021358:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387891.039255:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387892.061990:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787387892.274869:0:13046:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787387892.302097:0:13046:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787387892.302146:0:13046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.302162:0:13046:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.302171:0:13046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.302178:0:13046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.302275:0:13046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787387892.302282:0:13046:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787387892.302306:0:13046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787387892.302311:0:13046:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787387892.302316:0:13046:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787387892.302322:0:13046:0:(import.c:65:import_set_state_nolock()) ffff8d4377f7b800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787387892.302327:0:13046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787387892.302329:0:13046:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787387892.302331:0:13046:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787387892.304985:0:13046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.305006:0:13046:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.305014:0:13046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.305020:0:13046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.307324:0:13046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787387892.307347:0:13046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.307361:0:13046:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.307391:0:13046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.307398:0:13046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387892.307418:0:13046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1787387892.307424:0:13046:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787387892.307459:0:13046:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787387892.307464:0:13046:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787387892.307470:0:13046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787387892.307477:0:13046:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787387892.307487:0:13046:0:(genops.c:1840:print_export_data()) lustre-OST0000: UNLINKED ffff8d4373f28000 lustre-MDT0000-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967324 stale:0 00000020:00080000:1.0:1787387892.307494:0:13046:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8d43434ab380) has no exports 00000020:00080000:1.0:1787387892.307531:0:13046:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8d43434ab380) has no exports 00010000:00010000:0.0:1787387892.308722:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787387892.308733:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.308760:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4000 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387892.308765:0:11539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.308775:0:11539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387892.308782:0:11539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387892.308789:0:11539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787387892.308791:0:11539:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787387892.308794:0:11539:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787387892.308836:0:11539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.308842:0:11539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387892.308882:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.308889:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4000/0x93d41aeaa23c764b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7652 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.308904:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387892.308907:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.308913:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91400 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387892.308916:0:11539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.308922:0:11539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387892.308929:0:11539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387892.308933:0:11539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787387892.308936:0:11539:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787387892.308938:0:11539:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787387892.308952:0:11539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.308958:0:11539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387892.308975:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.308981:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4242f91400/0x93d41aeaa23c7659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7660 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.309000:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387892.309003:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.309009:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91a00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387892.309012:0:11539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.309019:0:11539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387892.309025:0:11539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387892.309030:0:11539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787387892.309032:0:11539:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787387892.309034:0:11539:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787387892.309059:0:11539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.309065:0:11539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387892.309073:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.309079:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4242f91a00/0x93d41aeaa23c7890 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x93d41aeaa23c7897 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387892.309088:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387892.309090:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387892.309098:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387892.309119:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709737088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387892.309187:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387892.309254:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709737216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387892.309278:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387892.309297:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387892.309302:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709737344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387892.309323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387892.309355:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709737088 00000100:00100000:0.0:1787387892.309362:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709737088 00000100:00100000:0.0:1787387892.309400:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709737216 00000100:00100000:0.0:1787387892.309403:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709737216 00000100:00100000:0.0:1787387892.309417:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709737344 00000100:00100000:0.0:1787387892.309419:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709737344 00000100:00100000:0.0:1787387892.309431:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787387892.309440:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1874211709737088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787387892.309446:0:5794:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787387892 with bad export cookie 10652168613684605748 00000100:00100000:1.0:1787387892.309839:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787387892.309847:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1874211709737216:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787387892.309853:0:5793:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787387892 with bad export cookie 10652168613684605748 00000100:00100000:1.0:1787387892.309953:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1874211709737216:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (672us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787387892.309960:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787387892.310075:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387892.310081:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43465c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1874211709737344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787387892.310086:0:5793:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787387892 with bad export cookie 10652168613684605748 00000100:00100000:1.0:1787387892.310114:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43465c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1874211709737344:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (789us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787387892.310120:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787387892.313852:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787387892.313860:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8d43450a7000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787387892.313865:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1787387892.313943:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387892.317194:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787387892.326790:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.159@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787387892.326796:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787387892.326808:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d437ab45880 x1874211709737088/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787387908 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387892.326843:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d437ab47800 x1874211709737216/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787387908 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387892.326851:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d437ab47480 x1874211709737344/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787387908 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787387892.326859:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787387892.326862:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787387892.326863:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787387892.326867:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8d43450a7000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787387892.326872:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 145 00000100:00080000:1.0:1787387892.326882:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.204.159@tcp: import ffff8d43450a7000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1787387892.326915:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437a820e00 x1874211709737472/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787387892.326961:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3310:1874211709737472:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1787387892.327012:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874211709737472 offset 0 length 520: 4 00000100:00100000:1.0:1787387892.327094:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709737216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387892.327112:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3313:1874211709737344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787387892.328702:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3312:1874211709737088:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1787387892.344275:0:5794:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874211709737088 offset 224 length 224: 4 00000100:00100000:0.0:1787387892.344300:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1874211709737088:12345-0@lo:103:ldlm_bl.0 Request processed in 34859us (35112us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787387892.344312:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000001:00100000:0.0:1787387892.355626:0:7514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787387892.355636:0:7514:0:(genops.c:906:class_export_put()) final put ffff8d42411a1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787387892.355766:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d42411a1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787387892.355816:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d42411a2000 for lustre-OST0001 00010000:00010000:3.0:1787387893.085979:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787387893.421384:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787387893.421396:0:6629:0:(genops.c:906:class_export_put()) final put ffff8d4373f28000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787387893.421948:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4373f28000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787387893.421997:0:474:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4242d48800 for lustre-OST0000 00010000:00010000:0.0:1787387894.112289:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787387894.371368:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787387894.371389:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787387894.371393:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787387894.371409:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787387894.371413:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d4373f2e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787387894.371422:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 393 00000100:00080000:0.0:1787387894.371429:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787387894.371437:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d4373f2e800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1787387894.371487:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437ab46300 x1874211709737600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787387894.371546:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874211709737600:0@lo:38:kworker.0 00000400:00000100:0.0:1787387894.371598:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211709737600 offset 0 length 520: 4 00000020:01000000:2.0:1787387894.371980:0:13046:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d434385b420 - data ffff8d4372a5d000/ffff8d4345d16c00 00000020:01000000:2.0:1787387894.372117:0:13046:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d4242b86120 - data ffff8d4365806510/ffff8d437f78ec00 00100000:10000000:3.0:1787387894.399186:0:13046:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787387894.435688:0:13046:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7468 00000020:00000080:0.0:1787387894.435697:0:13046:0:(genops.c:906:class_export_put()) final put ffff8d4377cbf800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787387894.435731:0:13046:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4379110800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787387894.435735:0:13046:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4379110800 2 00000020:01000004:0.0:1787387894.435759:0:13046:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d4379110800 from lustre-OST0000 00000020:00000080:0.0:1787387894.435788:0:13046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787387894.435798:0:13046:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787387894.435801:0:13046:0:(genops.c:906:class_export_put()) final put ffff8d4377cb8000/lustre-OST0000_UUID 00000020:00000080:0.0:1787387894.435804:0:13046:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4377cb8000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787387894.435809:0:13046:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787387894.435855:0:13046:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787387894.435859:0:13046:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787387894.435863:0:13046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787387894.435867:0:13046:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787387894.435873:0:13046:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d4377f78000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787387894.435879:0:13046:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8d4343528000) has exports, disconnecting them 00000020:00080000:0.0:1787387894.435884:0:13046:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d4377f78000), last request at 1787387659 00000020:00000080:0.0:1787387894.435888:0:13046:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7492 00000020:00080000:0.0:1787387894.435921:0:13046:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d4377f78000): rc 0 00000020:00000080:0.0:1787387894.435927:0:13046:0:(genops.c:906:class_export_put()) final put ffff8d4377f78000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787387894.437121:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4377cbf800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787387894.437146:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4377f78000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787387894.438031:0:13046:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787387894.438038:0:13046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787387894.438042:0:13046:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787387894.438048:0:13046:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787387894.438192:0:13046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787387894.438200:0:13046:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1787387894.438207:0:13046:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4379110800 1 00000020:00000080:1.0:1787387894.438214:0:13046:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7422 00000020:00000080:1.0:1787387894.438222:0:13046:0:(genops.c:906:class_export_put()) final put ffff8d4373f28800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787387894.438227:0:13046:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787387894.438231:0:13046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787387894.438235:0:13046:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787387894.438238:0:13046:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8d43747d0000) has no exports 00000020:00000080:3.0:1787387894.438784:0:474:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4377f7b800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787387894.438793:0:474:0:(genops.c:906:class_export_put()) final put ffff8d4377caf800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787387894.438796:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4377caf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787387894.438802:0:474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787387894.438863:0:474:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4373f28800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787387894.457489:0:13046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787387894.457505:0:13046:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787387894.457511:0:13046:0:(genops.c:906:class_export_put()) final put ffff8d43747dd800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787387894.457517:0:13046:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43747dd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787387894.457524:0:13046:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787387894.457667:0:13046:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d4379111000 00000020:02000400:1.0:1787387894.459002:0:13046:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787387895.137338:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387896.157987:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387897.182986:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787387897.191217:0:13199:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787387897.202927:0:13199:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787387897.203101:0:13199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.203118:0:13199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.203126:0:13199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.203133:0:13199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.203156:0:13199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787387897.203161:0:13199:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787387897.203187:0:13199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787387897.203197:0:13199:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d437ab46300 x1874211709737600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787387909 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387897.203212:0:13199:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787387897.203240:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4373f2e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787387897.203244:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1787387897.203248:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874211709737600:0@lo:38:kworker.0 00000100:00080000:0.0:1787387897.203273:0:13199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787387897.203277:0:13199:0:(import.c:65:import_set_state_nolock()) ffff8d4373f2e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787387897.203281:0:13199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787387897.203294:0:13199:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787387897.203298:0:13199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787387897.204234:0:13199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204247:0:13199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204253:0:13199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204260:0:13199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204279:0:13199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787387897.204286:0:13199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204292:0:13199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204299:0:13199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204305:0:13199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204317:0:13199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1787387897.204320:0:13199:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787387897.204336:0:13199:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787387897.204340:0:13199:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:0.0:1787387897.204362:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787387897.204369:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204376:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4800 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387897.204380:0:11539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204388:0:11539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387897.204395:0:11539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387897.204400:0:11539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787387897.204402:0:11539:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787387897.204404:0:11539:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787387897.204419:0:11539:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d43450a7000 00010000:00010000:0.0:1787387897.204423:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204430:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4800/0x93d41aeaa23c762f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x93d41aeaa23c7636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204442:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387897.204444:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204449:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90200 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387897.204452:0:11539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204468:0:11539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387897.204475:0:11539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387897.204480:0:11539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787387897.204483:0:11539:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787387897.204484:0:11539:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787387897.204490:0:11539:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d43450a7000 00010000:00010000:0.0:1787387897.204493:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204500:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4242f90200/0x93d41aeaa23c763d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x93d41aeaa23c7644 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204508:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387897.204510:0:11539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204516:0:11539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90a00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387897.204519:0:11539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204525:0:11539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387897.204531:0:11539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387897.204545:0:11539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787387897.204547:0:11539:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787387897.204549:0:11539:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787387897.204553:0:11539:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d43450a7000 00010000:00010000:0.0:1787387897.204556:0:11539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204562:0:11539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4242f90a00/0x93d41aeaa23c7882 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x93d41aeaa23c7889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.204574:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387897.204575:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387897.204577:0:11539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787387897.204587:0:13199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787387897.204593:0:13199:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787387897.204598:0:13199:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8d43451819c0) has no exports 00000020:00080000:0.0:1787387897.204620:0:13199:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8d43451819c0) has no exports 00010000:00010000:2.0:1787387897.205947:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787387897.207268:0:13199:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d434656e0c0 - data ffff8d4365a8b0d8/ffff8d43745e2800 00000020:01000000:0.0:1787387897.207412:0:13199:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d43745e7f00 - data ffff8d4372a16e58/ffff8d437401a800 00010000:00010000:2.0:1787387897.207764:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787387897.233256:0:13199:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787387897.257052:0:13199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7533 00000020:00000080:3.0:1787387897.257062:0:13199:0:(genops.c:906:class_export_put()) final put ffff8d4377ca8000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787387897.257114:0:13199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4377c90800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787387897.257118:0:13199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4377c90800 2 00000020:01000004:3.0:1787387897.257121:0:13199:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d4377c90800 from lustre-OST0001 00000020:00000080:3.0:1787387897.257146:0:13199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787387897.257156:0:13199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787387897.257160:0:13199:0:(genops.c:906:class_export_put()) final put ffff8d43746cd800/lustre-OST0001_UUID 00000020:00000080:3.0:1787387897.257163:0:13199:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43746cd800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787387897.257170:0:13199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787387897.257260:0:13199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a->MGS 00010000:00010000:3.0:1787387897.257274:0:13199:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4e00/0x93d41aeaa23c7445 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c744c expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387897.257286:0:13199:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4e00/0x93d41aeaa23c7445 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c744c expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387897.257293:0:13199:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787387897.257295:0:13199:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787387897.257298:0:13199:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787387897.257310:0:13199:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d43450a7000 00010000:00010000:3.0:1787387897.257314:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4342ad4e00/0x93d41aeaa23c7445 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x93d41aeaa23c744c expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.257326:0:13199:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x93d41aeaa23c768a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387897.257332:0:13199:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x93d41aeaa23c768a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387897.257346:0:13199:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787387897.257349:0:13199:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787387897.257350:0:13199:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787387897.257358:0:13199:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d43450a7000 00010000:00010000:3.0:1787387897.257361:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d4340030400/0x93d41aeaa23c7683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x93d41aeaa23c768a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787387897.257375:0:13199:0:(import.c:65:import_set_state_nolock()) ffff8d43450a7000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787387897.257378:0:13199:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787387897.257380:0:13199:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787387897.257382:0:13199:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787387897.257385:0:13199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787387897.257395:0:13199:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d437a820e00 x1874211709737472/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787387902 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787387897.257414:0:13199:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787387897.257416:0:13199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:0.0:1787387897.257474:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a:3310:1874211709737472:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:3.0:1787387897.257527:0:13199:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787387897.257533:0:13199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7326 00000020:00000080:3.0:1787387897.257537:0:13199:0:(genops.c:906:class_export_put()) final put ffff8d4360801000/2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a 00000020:00000080:1.0:1787387897.257635:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4377ca8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787387897.257724:0:13199:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.159@tcp (flags='') 00000020:00000080:3.0:1787387897.257729:0:13199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787387897.257734:0:13199:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.159@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787387897.260987:0:13199:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8d43434a99c0) has no exports 10000000:01000000:2.0:1787387897.261143:0:5804:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:1.0:1787387897.261357:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4360801000/2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a for MGC192.168.204.159@tcp 10000000:01000000:3.0:1787387897.261404:0:13199:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.159@tcp: client import never connected 00000100:00080000:3.0:1787387897.261409:0:13199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787387897.261412:0:13199:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787387897.261415:0:13199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787387897.261418:0:13199:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787387897.261498:0:13199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787387897.261507:0:13199:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.159@tcp (uuid 2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a) 00000020:01000000:3.0:1787387897.261514:0:13199:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787387897.261527:0:13199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787387897.261533:0:13199:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787387897.261539:0:13199:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d43747d9800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787387897.261545:0:13199:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff8d4242c999c0) has exports, disconnecting them 00000020:00080000:3.0:1787387897.261549:0:13199:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d43747d9800), last request at 1787387681 00000020:00000080:3.0:1787387897.261554:0:13199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c755d 00000020:00080000:3.0:1787387897.261567:0:13199:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d43747d9800): rc 0 00000020:00000080:3.0:1787387897.261571:0:13199:0:(genops.c:906:class_export_put()) final put ffff8d43747d9800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787387897.261663:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d43450a7000 for MGC192.168.204.159@tcp 00000020:00000080:1.0:1787387897.261670:0:8:0:(genops.c:906:class_export_put()) final put ffff8d43450a1800/2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a 00000020:00000080:1.0:1787387897.261672:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43450a1800/2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a for MGC192.168.204.159@tcp 00000020:01000000:1.0:1787387897.261677:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.159@tcp (2e8f2324-ef3a-4e9e-91ee-2dbfbb34f93a) 00000020:00000080:1.0:1787387897.263129:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d43747d9800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787387897.266831:0:13199:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787387897.266841:0:13199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787387897.266846:0:13199:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787387897.266866:0:13199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787387897.266933:0:11539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1787387897.267096:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4373f2e800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787387897.267306:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787387897.267483:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787387897.267642:0:5790:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d4352eeb000:5790] 0 exiting: rc = 1 00000100:00100000:0.0:1787387897.270863:0:5791:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d436f357a00:5791] 1 exiting: rc = 0 00000100:00100000:1.0:1787387897.271156:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.271413:0:5792:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d436f357200:5792] 0 exiting: rc = 1 00000100:00100000:1.0:1787387897.271489:0:8324:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d4377c1e200:8324] 3 exiting: rc = 0 00000100:00100000:0.0:1787387897.271587:0:5793:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d436f356e00:5793] 1 exiting: rc = 0 00000100:00100000:0.0:1787387897.271638:0:5794:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d436f357400:5794] 2 exiting: rc = 0 00000100:00100000:3.0:1787387897.274093:0:11042:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8d4347187200:11042] 4 exiting: rc = 0 00000100:00100000:1.0:1787387897.274280:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274290:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274297:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274304:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274312:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274318:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274324:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274330:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274336:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274342:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274348:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274355:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274361:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274372:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274377:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274383:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274390:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274397:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274402:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274407:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274412:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274416:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274421:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274425:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274431:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274437:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274442:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274447:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274467:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274472:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274477:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274482:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274488:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274494:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274499:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274505:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274511:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274516:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274521:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274526:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274530:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274536:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274540:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274544:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274550:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274555:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274560:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274565:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274572:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274577:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274582:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274586:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274592:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274597:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274601:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274606:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274611:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274616:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274622:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274627:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274633:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274639:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274644:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.274657:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787387897.275718:0:13199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787387897.275729:0:13199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787387897.275734:0:13199:0:(genops.c:906:class_export_put()) final put ffff8d4347382800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787387897.275765:0:13199:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4347382800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787387897.275775:0:13199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787387897.275826:0:13199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4377c90800 1 00000020:00000080:0.0:1787387897.275832:0:13199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x93d41aeaa23c7502 00000020:00000080:0.0:1787387897.275837:0:13199:0:(genops.c:906:class_export_put()) final put ffff8d4377c93000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787387897.275995:0:13199:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787387897.276001:0:13199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787387897.276006:0:13199:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787387897.276010:0:13199:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8d43435299c0) has no exports 00000020:00000080:3.0:1787387897.276085:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4377c93000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787387897.288286:0:13199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787387897.288301:0:13199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787387897.288308:0:13199:0:(genops.c:906:class_export_put()) final put ffff8d4377c91000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787387897.288313:0:13199:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4377c91000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787387897.288321:0:13199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787387897.288512:0:13199:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d4377c96000 00000020:01000000:3.0:1787387897.288534:0:13199:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787387897.288538:0:13199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787387897.288543:0:13199:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787387897.288548:0:13199:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8d43747d19c0) has no exports 00000020:00000080:3.0:1787387897.288575:0:13199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787387897.288580:0:13199:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787387897.288583:0:13199:0:(genops.c:906:class_export_put()) final put ffff8d4373f2f800/OSS_uuid 00000020:00000080:3.0:1787387897.288586:0:13199:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4373f2f800/OSS_uuid for OSS 00000020:01000000:3.0:1787387897.288590:0:13199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787387897.288616:0:5803:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787387897.288992:0:6606:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8d4351743a00:6606] 2 exiting: rc = 0 00000100:00100000:1.0:1787387897.289045:0:11067:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8d4350394800:11067] 3 exiting: rc = 0 00000100:00100000:1.0:1787387897.289113:0:6605:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8d4373efa600:6605] 1 exiting: rc = 0 00000100:00100000:1.0:1787387897.289154:0:6604:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8d4373f64800:6604] 0 exiting: rc = 1 00000100:00100000:3.0:1787387897.289544:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289560:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289569:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289575:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289581:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289598:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289603:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289608:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289613:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289617:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289622:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289627:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289632:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289637:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289642:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289647:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289652:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289657:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289661:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289667:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289672:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289677:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289682:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289687:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289692:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289697:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289703:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289709:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289714:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289719:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289725:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289730:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289761:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289769:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289773:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289779:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289784:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289790:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289795:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289801:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289813:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289819:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289824:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289829:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289834:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289840:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289846:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289866:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289872:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289878:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289884:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289890:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289896:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289905:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289912:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289917:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289923:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289928:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289933:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289939:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289944:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289949:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289965:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.289970:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.290654:0:6608:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d4351743000:6608] 1 exiting: rc = 0 00000100:00100000:1.0:1787387897.291049:0:6607:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d4350e0e800:6607] 0 exiting: rc = 1 00000100:00100000:3.0:1787387897.291144:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291152:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291158:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291163:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291168:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291173:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291178:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291183:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291188:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291194:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291210:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291215:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291220:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291225:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291231:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291236:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291242:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291247:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291252:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291258:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291281:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291287:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291292:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291297:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291302:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291307:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291311:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291317:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291321:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291326:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291331:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291336:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291341:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291346:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291351:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291356:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291361:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291366:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291371:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291375:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291380:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291384:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291390:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291395:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291400:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291412:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291417:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291422:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291427:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291431:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291436:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291441:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291445:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291449:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291453:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291457:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291461:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291465:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291469:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291474:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291478:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291483:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291488:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787387897.291497:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.292721:0:6610:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d4351742200:6610] 1 exiting: rc = 0 00000100:00100000:3.0:1787387897.293119:0:6611:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d4351743600:6611] 2 exiting: rc = 0 00000100:00100000:0.0:1787387897.293371:0:6609:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d4351743c00:6609] 0 exiting: rc = 1 00000100:00100000:1.0:1787387897.295234:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295243:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295249:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295255:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295260:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295268:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295274:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295280:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295286:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295292:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295298:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295303:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295310:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295335:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295342:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295348:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295354:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295360:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295365:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295370:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295376:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295382:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295387:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295393:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295399:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295405:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295410:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295428:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295434:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295440:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295446:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295452:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295458:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295464:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295469:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295474:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295480:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295500:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295507:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295512:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295517:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295523:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295529:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295535:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295541:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295547:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295553:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295558:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295564:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295570:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295575:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295581:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295587:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295593:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295599:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295604:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295609:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295615:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295620:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295626:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295633:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295639:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295652:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.295658:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.305512:0:6613:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d4347d75000:6613] 1 exiting: rc = 0 00000100:00100000:0.0:1787387897.305810:0:6612:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d4347d75800:6612] 0 exiting: rc = 1 00000100:00100000:1.0:1787387897.306163:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306171:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306176:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306188:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306194:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306199:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306205:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306256:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306263:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306268:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306274:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306279:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306284:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306289:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306294:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306299:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306304:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306310:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306315:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306319:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306325:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306330:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306334:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306339:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306344:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306349:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306354:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306359:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306364:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306369:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306373:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306378:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306397:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306402:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306407:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306411:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306417:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306422:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306427:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306433:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306438:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306443:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306448:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306452:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306457:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306462:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306466:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306471:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306477:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306483:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306487:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306492:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306497:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306501:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306507:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306512:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306517:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306522:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306528:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306533:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306538:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306543:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306549:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787387897.306560:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308067:0:6614:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d4351756c00:6614] 0 exiting: rc = 1 00000100:00100000:1.0:1787387897.308486:0:6615:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d4351757a00:6615] 1 exiting: rc = 0 00000100:00100000:0.0:1787387897.308591:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308612:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308618:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308625:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308631:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308637:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308643:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308649:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308655:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308661:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308667:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308673:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308679:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308699:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308707:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308712:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308718:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308762:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308769:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308774:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308781:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308787:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308794:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308800:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308807:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308829:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308837:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308843:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.308849:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309006:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309013:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309020:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309027:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309034:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309043:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309048:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309054:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309075:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309081:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309087:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309094:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309100:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309107:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309114:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309120:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309127:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309134:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309141:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309147:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309166:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309174:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309182:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309195:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309201:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309207:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309213:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309219:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309227:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309234:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309240:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309246:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309269:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309277:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787387897.309283:0:13199:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787387897.318065:0:13199:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787387914.388987:0:13815:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787387921.813218:0:14227:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787387921.813224:0:14227:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787387921.813343:0:14227:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d437a1bb000 00000020:01000004:3.0:1787387921.813356:0:14227:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787387921.813363:0:14227:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787387921.813386:0:14227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d43434acd40) 00000020:00000080:3.0:1787387921.813408:0:14227:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787387921.842399:0:14227:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787387921.845368:0:14227:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787387921.848340:0:14227:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787387921.848430:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 449: rc = 0 00100000:10000000:2.0:1787387921.848561:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 449: rc = 0 00100000:10000000:2.0:1787387921.848659:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 449: rc = 0 00100000:10000000:2.0:1787387921.848788:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 449: rc = 0 00100000:10000000:2.0:1787387921.848888:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 449: rc = 0 00100000:10000000:2.0:1787387921.849044:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 449: rc = 0 00100000:10000000:2.0:1787387921.849301:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 512: rc = 0 00100000:10000000:2.0:1787387921.858212:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 122: rc = 0 00100000:10000000:2.0:1787387921.858332:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 122: rc = 0 00100000:10000000:2.0:1787387921.858819:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 652: rc = 0 00100000:10000000:2.0:1787387921.859172:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 652: rc = 0 00100000:10000000:2.0:1787387921.859438:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 652: rc = 0 00100000:10000000:2.0:1787387921.859704:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 652: rc = 0 00100000:10000000:2.0:1787387921.859992:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 652: rc = 0 00100000:10000000:1.0:1787387921.860619:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 652: rc = 0 00100000:10000000:1.0:1787387921.860971:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 652: rc = 0 00100000:10000000:1.0:1787387921.861221:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 652: rc = 0 00100000:10000000:1.0:1787387921.861487:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 652: rc = 0 00100000:10000000:1.0:1787387921.861780:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 652: rc = 0 00100000:10000000:1.0:1787387921.862032:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 652: rc = 0 00100000:10000000:1.0:1787387921.862268:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 652: rc = 0 00100000:10000000:1.0:1787387921.862691:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 459: rc = 0 00100000:10000000:1.0:1787387921.862968:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 459: rc = 0 00100000:10000000:1.0:1787387921.863224:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 459: rc = 0 00100000:10000000:1.0:1787387921.863569:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 459: rc = 0 00100000:10000000:1.0:1787387921.863871:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 459: rc = 0 00100000:10000000:1.0:1787387921.864111:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 459: rc = 0 00100000:10000000:1.0:1787387921.864357:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 459: rc = 0 00100000:10000000:1.0:1787387921.864620:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 459: rc = 0 00100000:10000000:1.0:1787387921.864907:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 459: rc = 0 00100000:10000000:1.0:1787387921.865147:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 459: rc = 0 00100000:10000000:1.0:1787387921.865388:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 459: rc = 0 00100000:10000000:1.0:1787387921.865644:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 459: rc = 0 00100000:10000000:1.0:1787387921.865932:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 459: rc = 0 00100000:10000000:1.0:1787387921.866181:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 459: rc = 0 00100000:10000000:1.0:1787387921.866435:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 459: rc = 0 00100000:10000000:1.0:1787387921.866692:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 459: rc = 0 00100000:10000000:1.0:1787387921.866975:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 459: rc = 0 00100000:10000000:1.0:1787387921.867217:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 459: rc = 0 00100000:10000000:1.0:1787387921.867484:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 459: rc = 0 00100000:10000000:1.0:1787387921.867733:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 459: rc = 0 00100000:10000000:1.0:1787387921.868118:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 459: rc = 0 00100000:10000000:1.0:1787387921.868354:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 459: rc = 0 00100000:10000000:1.0:1787387921.868613:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 459: rc = 0 00100000:10000000:1.0:1787387921.868981:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 459: rc = 0 00100000:10000000:1.0:1787387921.869239:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 459: rc = 0 00100000:10000000:1.0:1787387921.869498:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 459: rc = 0 00100000:10000000:1.0:1787387921.869729:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 459: rc = 0 00100000:10000000:1.0:1787387921.870018:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 459: rc = 0 00100000:10000000:1.0:1787387921.870271:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 459: rc = 0 00100000:10000000:1.0:1787387921.870572:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 459: rc = 0 00100000:10000000:1.0:1787387921.870844:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 459: rc = 0 00100000:10000000:1.0:1787387921.871093:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 459: rc = 0 00100000:10000000:1.0:1787387921.871440:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 284: rc = 0 00100000:10000000:1.0:1787387921.871998:0:14227:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1787387921.872157:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 123: rc = 0 00100000:10000000:1.0:1787387921.872333:0:14227:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1787387921.872404:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 123: rc = 0 00100000:10000000:1.0:1787387921.872599:0:14227:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1787387921.872665:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 123: rc = 0 00100000:10000000:1.0:1787387921.873045:0:14227:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1787387921.873112:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 453: rc = 0 00100000:10000000:1.0:1787387921.873302:0:14227:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787387921.873385:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 453: rc = 0 00100000:10000000:1.0:1787387921.873580:0:14227:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787387921.873650:0:14227:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 453: rc = 0 00000020:00000080:1.0:1787387921.873955:0:14227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787387921.873971:0:14227:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787387921.873982:0:14227:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c8627 00000020:01000004:1.0:1787387921.873990:0:14227:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787387921.873995:0:14227:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787387921.874000:0:14227:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d437a1bb000 from MGS 00000020:01000004:1.0:1787387921.874004:0:14227:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787387921.874015:0:14227:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d43435299c0) 00000020:00000080:1.0:1787387921.874025:0:14227:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787387921.874082:0:14227:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d437a1bb000 from MGS, refs=2 00080000:01000000:1.0:1787387921.874087:0:14227:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787387921.874091:0:14227:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c8635 00000100:00100000:1.0:1787387921.874189:0:14227:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787387921.874306:0:14227:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787387921.874313:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787387921.874972:0:14227:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787387921.874980:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787387921.875621:0:14227:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387921.875823:0:14227:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787387921.875829:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787387921.876267:0:14227:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787387921.876274:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787387921.876572:0:14227:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787387921.876579:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787387921.877189:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387921.877193:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387921.877194:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387921.877454:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387921.877456:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387921.877458:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387921.877938:0:14227:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787387921.881676:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787387921.886573:0:14227:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787387921.886592:0:14227:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787387921.886595:0:14227:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787387921.888116:0:14236:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787387921.888248:0:14227:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787387921.888343:0:14227:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787387921.888825:0:14227:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787387921.889123:0:14227:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387921.889255:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787387921.889261:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787387921.890479:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787387921.890487:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787387921.891179:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787387921.891186:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1787387921.892584:0:14241:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1787387921.895615:0:14227:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787387921.895644:0:14227:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.159@tcp' 00000020:01000004:2.0:1787387921.895646:0:14227:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787387921.895676:0:14227:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.159@tcp (typ=mgc) 00000020:00000080:2.0:1787387921.895688:0:14227:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.159@tcp (ffff8d4345184d40) 00000020:00000080:2.0:1787387921.895703:0:14227:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787387921.895798:0:14227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d43521d6800@MGC192.168.204.159@tcp: add connection 192.168.204.159@tcp at head 00010000:00010000:2.0:1787387921.895953:0:14227:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.159@tcp-0 is initialized 00000040:01000000:2.0:1787387921.895960:0:14227:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787387921.898028:0:14243:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787387921.898122:0:14227:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.159@tcp (uuid 498227b4-d0f5-4d95-bb91-ab0eaf258c1d) 00000020:00000080:1.0:1787387921.898148:0:14227:0:(genops.c:1406:class_connect()) connect: client 498227b4-d0f5-4d95-bb91-ab0eaf258c1d, cookie 0x93d41aeaa23c8643 00000100:00080000:1.0:1787387921.898159:0:14227:0:(import.c:510:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787387921.898167:0:14227:0:(import.c:624:import_select_connection()) MGC192.168.204.159@tcp: import ffff8d43521d6800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1787387921.898198:0:14227:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437a822a00 x1874211709737728/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787387921.898257:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3310:1874211709737728:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787387921.898325:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.898428:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709737728 00000100:00100000:1.0:1787387921.898435:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709737728 00000100:00100000:1.0:1787387921.898464:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387921.898478:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874211709737728:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787387921.898499:0:14237:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 498227b4-d0f5-4d95-bb91-ab0eaf258c1d@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:1.0:1787387921.898522:0:14237:0:(genops.c:1406:class_connect()) connect: client 498227b4-d0f5-4d95-bb91-ab0eaf258c1d, cookie 0x93d41aeaa23c864a 00000100:00080000:1.0:1787387921.898632:0:14237:0:(import.c:65:import_set_state_nolock()) ffff8d4342bea000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387921.898827:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+5:3310:x1874211709737728:12345-0@lo:250:mount.lustre.0 Request processed in 355us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.898836:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787387921.898863:0:14227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 498227b4-d0f5-4d95-bb91-ab0eaf258c1d->MGS 00000020:01000004:1.0:1787387921.898891:0:14227:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787387921.898896:0:14227:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787387921.898908:0:14227:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d4343528000) 00000020:00000080:1.0:1787387921.898918:0:14227:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787387921.904029:0:3310:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787387921.904044:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.159@tcp: connect to target with instance 0 00000100:00080000:0.0:1787387921.904053:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787387921.904059:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787387921.904063:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d43521d6800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787387921.904067:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787387921.904075:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787387921.904084:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3310:1874211709737728:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787387921.912059:0:14227:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387921.912231:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787387921.912237:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787387921.913359:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787387921.913438:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787387921.914511:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787387921.914522:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787387921.915466:0:14227:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387921.915644:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787387921.915649:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787387921.916106:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787387921.916113:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787387921.946560:0:14227:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387921.947040:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787387921.947048:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787387921.948089:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787387921.948100:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787387921.948682:0:14227:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387921.949050:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787387921.949055:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787387921.949501:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787387921.949507:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787387921.950240:0:14227:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387921.950437:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787387921.950445:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787387921.951067:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787387921.951075:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787387921.951733:0:14227:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387921.952002:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787387921.952007:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787387921.952476:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787387921.952483:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787387921.966856:0:14227:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387921.967072:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787387921.967078:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787387921.968536:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787387921.968548:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787387921.969503:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787387921.969512:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787387921.970311:0:14227:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787387921.970333:0:14227:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787387921.970340:0:14227:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787387921.970551:0:14227:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787387921.970585:0:14227:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787387921.970590:0:14227:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787387921.970591:0:14227:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787387921.970592:0:14227:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387921.970594:0:14227:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387921.970595:0:14227:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387921.970596:0:14227:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387921.970598:0:14227:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387921.970599:0:14227:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787387921.970601:0:14227:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387921.970602:0:14227:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787387921.970605:0:14227:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787387921.970607:0:14227:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787387921.970608:0:14227:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787387921.970610:0:14227:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387921.970611:0:14227:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387921.970612:0:14227:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387921.970613:0:14227:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387921.970614:0:14227:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387921.970615:0:14227:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787387921.970616:0:14227:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387921.970618:0:14227:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787387921.970644:0:14227:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787387921.970669:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709737856:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787387921.970861:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.970934:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a8da180 going to sleep for 11 seconds 00000100:00100000:0.0:1787387921.970987:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709737856 00000100:00100000:0.0:1787387921.970995:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709737856 00000100:00100000:0.0:1787387921.971067:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387921.971076:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+5:14227:x1874211709737856:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787387921.971120:0:14239:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787387921.971123:0:14239:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787387921.971126:0:14239:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787387921.971502:0:14261:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787387921.973016:0:14239:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787387921.974444:0:14262:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787387921.974451:0:14262:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787387921.974454:0:14262:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787387921.974506:0:14262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787387921.975016:0:14239:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787387921.975027:0:14239:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787387921.980804:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+5:14227:x1874211709737856:12345-0@lo:253:mount.lustre.0 Request processed in 9722us (9935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.980822:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387921.980930:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709737856:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787387921.980946:0:14227:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787387921.980949:0:14227:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787387921.980951:0:14227:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787387921.980952:0:14227:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387921.980953:0:14227:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387921.980954:0:14227:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387921.980955:0:14227:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387921.980957:0:14227:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387921.980958:0:14227:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787387921.980960:0:14227:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387921.980962:0:14227:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787387921.980980:0:14227:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d437a1bb000 from lustre-MDT0000 10000000:01000000:3.0:1787387921.981003:0:14227:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787387921.981006:0:14227:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787387921.981010:0:14227:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d4345184d40 10000000:01000000:3.0:1787387921.981014:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787387921.981021:0:14227:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d4345184d40 from 1 10000000:01000000:3.0:1787387921.981024:0:14227:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787387921.981060:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.981071:0:14227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.981100:0:14227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387921.981118:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709737984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787387921.981152:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.981191:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a8dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.981316:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709737984 00000100:00100000:2.0:1787387921.981323:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709737984 00000100:00100000:2.0:1787387921.981365:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387921.981540:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+5:14227:x1874211709737984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787387921.981554:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387921.981571:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43413fd000/0x93d41aeaa23c865f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c8658 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.981603:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43413fd000/0x93d41aeaa23c865f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c8658 expref: 6 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.981614:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43413fd000/0x93d41aeaa23c865f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8658 expref: 6 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.981624:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fd000, rc 0) 00000100:00100000:2.0:1787387921.981666:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+6:14227:x1874211709737984:12345-0@lo:101:mount.lustre.0 Request processed in 130us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.981713:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709737984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787387921.981726:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c865f expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.981753:0:14227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c865f expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387921.981799:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709738112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787387921.981825:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.981844:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a8dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387921.982013:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709738112 00000100:00100000:1.0:1787387921.982018:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709738112 00000100:00100000:1.0:1787387921.982038:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387921.982044:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+7:14227:x1874211709738112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787387921.982288:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+7:14227:x1874211709738112:12345-0@lo:501:mount.lustre.0 Request processed in 243us (461us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787387921.982312:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387921.982495:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387921.982557:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709738112:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787387921.982584:0:14227:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787387921.982649:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c865f expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.982658:0:14227:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c865f expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387921.982668:0:14227:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d437a1bb000 10000000:01000000:3.0:1787387921.982672:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787387921.982685:0:14227:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d437a1bb000 10000000:01000000:3.0:1787387921.982688:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787387921.982691:0:14227:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8d437a1bb000 from 1 10000000:01000000:3.0:1787387921.982693:0:14227:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787387921.982716:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460b000/0x93d41aeaa23c8666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.982724:0:14227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d437460b000/0x93d41aeaa23c8666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.982733:0:14227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d437460b000/0x93d41aeaa23c8666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387921.982804:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709738240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787387921.982831:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.982847:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a8da6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387921.982898:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709738240 00000100:00100000:1.0:1787387921.982902:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709738240 00000100:00100000:1.0:1787387921.982975:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387921.982983:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+6:14227:x1874211709738240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787387921.982992:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387921.983007:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c866d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c8666 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.983025:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c866d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c8666 expref: 7 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.983035:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152fa00/0x93d41aeaa23c866d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8666 expref: 7 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.983043:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152fa00, rc 0) 00000100:00100000:1.0:1787387921.983081:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+7:14227:x1874211709738240:12345-0@lo:101:mount.lustre.0 Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.983088:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387921.983143:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709738240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787387921.983154:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d437460b000/0x93d41aeaa23c8666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c866d expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.983163:0:14227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d437460b000/0x93d41aeaa23c8666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c866d expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387921.983175:0:14227:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787387921.983538:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460b000/0x93d41aeaa23c8666 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c866d expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.983547:0:14227:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d437460b000/0x93d41aeaa23c8666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c866d expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387921.983567:0:14227:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787387921.983570:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787387921.983575:0:14227:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d437a1bb000 10000000:01000000:3.0:1787387921.983578:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787387921.983581:0:14227:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787387921.983582:0:14227:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787387921.983599:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460ae00/0x93d41aeaa23c8674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.983607:0:14227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d437460ae00/0x93d41aeaa23c8674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.983614:0:14227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d437460ae00/0x93d41aeaa23c8674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387921.983627:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709738368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787387921.983655:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.983679:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a8da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.983728:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709738368 00000100:00100000:2.0:1787387921.983734:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709738368 00000100:00100000:2.0:1787387921.983790:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787387921.983796:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+7:14227:x1874211709738368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787387921.983804:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387921.983813:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c867b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c8674 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.983827:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c867b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c8674 expref: 8 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.983836:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43413fc200/0x93d41aeaa23c867b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8674 expref: 8 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.983842:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fc200, rc 0) 00000100:00100000:2.0:1787387921.983872:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+8:14227:x1874211709738368:12345-0@lo:101:mount.lustre.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.983878:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387921.983997:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709738368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787387921.984008:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d437460ae00/0x93d41aeaa23c8674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c867b expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.984015:0:14227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d437460ae00/0x93d41aeaa23c8674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c867b expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387921.984058:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709738496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787387921.984082:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.984105:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a8da6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387921.984156:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709738496 00000100:00100000:1.0:1787387921.984161:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709738496 00000100:00100000:1.0:1787387921.984192:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787387921.984198:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+8:14227:x1874211709738496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787387921.984727:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+9:14227:x1874211709738496:12345-0@lo:501:mount.lustre.0 Request processed in 528us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.984758:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787387921.984854:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709738496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787387921.984883:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709738624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787387921.984930:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.984951:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a8da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387921.984972:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709738624 00000100:00100000:3.0:1787387921.984977:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709738624 00000100:00100000:3.0:1787387921.985001:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387921.985007:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+9:14227:x1874211709738624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787387921.985313:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+9:14227:x1874211709738624:12345-0@lo:503:mount.lustre.0 Request processed in 305us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.985320:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387921.985360:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709738624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787387921.985928:0:14263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14263:1874211709738752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387921.985979:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.986010:0:14263:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374241000 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.986066:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709738752 00000100:00100000:2.0:1787387921.986072:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709738752 00000100:00100000:2.0:1787387921.986105:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387921.986111:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+9:14263:x1874211709738752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387921.986519:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+9:14263:x1874211709738752:12345-0@lo:502:llog_process_th.0 Request processed in 407us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.986528:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787387921.986649:0:14263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14263:1874211709738752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787387921.986672:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387921.986683:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387921.986686:0:14263:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787387921.986691:0:14263:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787387921.986693:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387921.986707:0:14263:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d434352b380) 00000020:00000080:1.0:1787387921.986724:0:14263:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787387921.986731:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787387921.986831:0:14263:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787387921.986839:0:14263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c8689 00000020:00000080:1.0:1787387921.987048:0:14263:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787387921.987052:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387921.987056:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387921.987057:0:14263:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787387921.987060:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387921.987063:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387921.987064:0:14263:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787387921.987067:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387921.987074:0:14263:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d434352cd40) 00000020:00000080:1.0:1787387921.987083:0:14263:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787387921.987086:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787387921.987088:0:14263:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787387921.987091:0:14263:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787387921.987096:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787387921.987132:0:14263:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d437a1bb000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787387921.987157:0:14263:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d4381443380) 00000020:00000080:1.0:1787387921.987172:0:14263:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787387921.987225:0:14263:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787387921.987235:0:14263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x93d41aeaa23c869e 00000020:00000080:1.0:1787387921.987535:0:14263:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787387921.987541:0:14263:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787387921.987547:0:14263:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x93d41aeaa23c86a5 00080000:01000000:1.0:1787387921.987552:0:14263:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787387921.987556:0:14263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c86ac 00010000:00010000:0.0:1787387922.061203:0:14263:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787387922.062179:0:14263:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1787387922.062551:0:14263:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787387922.063515:0:14263:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d4242c999c0) 00000020:00000080:0.0:1787387922.063534:0:14263:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787387922.063598:0:14263:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787387922.063603:0:14263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c86ba 00000020:00000080:1.0:1787387922.065515:0:14263:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787387922.079105:0:14263:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x93d41aeaa23c86c1 00000020:00000080:1.0:1787387922.081417:0:14263:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787387922.081432:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387922.081440:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387922.081442:0:14263:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787387922.081445:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387922.081450:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387922.081452:0:14263:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787387922.081456:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787387922.081519:0:14263:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787387922.081536:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387922.081539:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387922.081541:0:14263:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787387922.081544:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787387922.081546:0:14263:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1787387922.081548:0:14263:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787387922.081549:0:14263:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787387922.081551:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787387922.081554:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387922.081555:0:14263:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787387922.081558:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787387922.081562:0:14263:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787387922.081565:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387922.081567:0:14263:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787387922.081570:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787387922.081575:0:14263:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:1.0:1787387922.081599:0:14263:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787387922.081615:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387922.081629:0:14263:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d4381444d40) 00000020:00000080:1.0:1787387922.081645:0:14263:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787387922.081651:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787387922.081706:0:14263:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787387922.081713:0:14263:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787387922.081719:0:14263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c86cf 00010000:00080000:1.0:1787387922.081781:0:14263:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4377cb8800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1787387922.082022:0:14263:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787387922.082489:0:14263:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787387922.082537:0:14263:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787387922.083451:0:14263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387922.083531:0:14263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787387922.083595:0:14263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787387922.084835:0:14267:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787387922.084842:0:14267:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787387922.085999:0:14263:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787387922.086014:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787387922.086051:0:14263:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787387922.086071:0:14263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x93d41aeaa23c86d6 00000100:00080000:0.0:1787387922.086082:0:14263:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787387922.086088:0:14263:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d4377cb8800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1787387922.086124:0:14263:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437ab46300 x1874211709738880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787387922.086159:0:14263:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787387922.086256:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387922.086260:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387922.086262:0:14263:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787387922.086277:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787387922.086280:0:14263:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787387922.086282:0:14263:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787387922.086283:0:14263:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787387922.086285:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787387922.086288:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387922.086289:0:14263:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787387922.086292:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787387922.086296:0:14263:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787387922.086299:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387922.086307:0:14263:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787387922.086311:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787387922.086314:0:14263:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:0.0:1787387922.086338:0:14263:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787387922.086341:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787387922.086352:0:14263:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d4242c98000) 00000020:00000080:0.0:1787387922.086377:0:14263:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787387922.086383:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787387922.086442:0:14263:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787387922.086449:0:14263:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787387922.086455:0:14263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x93d41aeaa23c86e4 00010000:00080000:0.0:1787387922.086496:0:14263:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d437428e000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1787387922.086699:0:14263:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787387922.087140:0:14263:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787387922.087162:0:14263:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787387922.087538:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709738880:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787387922.087593:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211709738880 offset 0 length 520: 4 00000040:00080000:0.0:1787387922.088184:0:14263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387922.088260:0:14263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787387922.088328:0:14263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787387922.089327:0:14269:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787387922.089334:0:14269:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787387922.090225:0:14263:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787387922.090237:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787387922.090281:0:14263:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787387922.090302:0:14263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x93d41aeaa23c86eb 00000100:00080000:1.0:1787387922.090313:0:14263:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787387922.090318:0:14263:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d437428e000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1787387922.090356:0:14263:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437a820380 x1874211709739008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787387922.090501:0:14263:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787387922.090558:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709739008:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787387922.090616:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211709739008 offset 0 length 520: 4 00000020:01000000:1.0:1787387922.091852:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387922.091861:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387922.091999:0:14263:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787387922.092006:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387922.092010:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387922.092011:0:14263:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787387922.092014:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787387922.092015:0:14263:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787387922.092017:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387922.092020:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387922.092021:0:14263:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787387922.092023:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387922.092025:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387922.092026:0:14263:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787387922.092030:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787387922.092077:0:14263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14263:1874211709739136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387922.092157:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387922.092247:0:14263:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787387922.092499:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709739136 00000100:00100000:0.0:1787387922.092508:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709739136 00000100:00100000:0.0:1787387922.092562:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787387922.092572:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+9:14263:x1874211709739136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387922.092873:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+9:14263:x1874211709739136:12345-0@lo:502:llog_process_th.0 Request processed in 301us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387922.093001:0:14263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14263:1874211709739136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787387922.093031:0:14263:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387922.093035:0:14263:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387922.093037:0:14263:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787387922.093042:0:14263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:0.0:1787387922.093180:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:2.0:1787387922.093586:0:14227:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787387922.093609:0:14227:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787387922.093668:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460ae00/0x93d41aeaa23c8674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c867b expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.093679:0:14227:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d437460ae00/0x93d41aeaa23c8674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c867b expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387922.093685:0:14227:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d437a1bb000 from 1 10000000:01000000:2.0:1787387922.093688:0:14227:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787387922.093721:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.093729:0:14227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.093797:0:14227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387922.093817:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709739264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787387922.093868:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387922.094000:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643480 going to sleep for 11 seconds 00000100:00100000:3.0:1787387922.094074:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709739264 00000100:00100000:3.0:1787387922.094081:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709739264 00000100:00100000:3.0:1787387922.094159:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787387922.094168:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+9:14227:x1874211709739264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787387922.094179:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387922.094194:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c86f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c86f2 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387922.094215:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c86f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c86f2 expref: 10 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387922.094225:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c86f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c86f2 expref: 10 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387922.094247:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460bc00, rc 0) 00000100:00100000:3.0:1787387922.094357:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+10:14227:x1874211709739264:12345-0@lo:101:mount.lustre.0 Request processed in 189us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387922.094363:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387922.094481:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709739264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787387922.094496:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.094505:0:14227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387922.095189:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709739392:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787387922.095241:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387922.095657:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643480 going to sleep for 11 seconds 00000100:00100000:3.0:1787387922.095763:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709739392 00000100:00100000:3.0:1787387922.095770:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709739392 00000100:00100000:3.0:1787387922.095792:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787387922.095798:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+10:14227:x1874211709739392:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787387922.095813:0:14238:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787387922.095820:0:14238:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787387922.095901:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+10:14227:x1874211709739392:12345-0@lo:256:mount.lustre.0 Request processed in 102us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387922.095907:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387922.096560:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709739392:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787387922.097227:0:14227:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787387922.097325:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.097339:0:14227:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387922.097348:0:14227:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d437a1bb000 from 1 10000000:01000000:2.0:1787387922.097351:0:14227:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387922.097397:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.097404:0:14227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.097490:0:14227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387922.097510:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709739520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787387922.097561:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387922.097595:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643480 going to sleep for 11 seconds 00000100:00100000:0.0:1787387922.097792:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709739520 00000100:00100000:0.0:1787387922.097800:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709739520 00000100:00100000:0.0:1787387922.097849:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787387922.097858:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+10:14227:x1874211709739520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787387922.097869:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387922.097896:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4377c70000/0x93d41aeaa23c8707 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c8700 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.097919:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4377c70000/0x93d41aeaa23c8707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c8700 expref: 11 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.097929:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4377c70000/0x93d41aeaa23c8707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8700 expref: 11 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.097939:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70000, rc 0) 00000100:00100000:0.0:1787387922.097973:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14227:x1874211709739520:12345-0@lo:101:mount.lustre.0 Request processed in 116us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387922.097979:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387922.098355:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709739520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787387922.098437:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.098446:0:14227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387922.098516:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709739648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787387922.098544:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387922.098573:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643480 going to sleep for 11 seconds 00000100:00100000:0.0:1787387922.098627:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709739648 00000100:00100000:0.0:1787387922.098632:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709739648 00000100:00100000:0.0:1787387922.098663:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787387922.098670:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14227:x1874211709739648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787387922.099354:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14227:x1874211709739648:12345-0@lo:501:mount.lustre.0 Request processed in 682us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387922.099362:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387922.100729:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709739648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787387922.100799:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709739776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787387922.100863:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387922.101028:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643480 going to sleep for 11 seconds 00000100:00100000:0.0:1787387922.101111:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709739776 00000100:00100000:0.0:1787387922.101118:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709739776 00000100:00100000:0.0:1787387922.101165:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787387922.101175:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14227:x1874211709739776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787387922.101438:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14227:x1874211709739776:12345-0@lo:503:mount.lustre.0 Request processed in 264us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387922.101454:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387922.101633:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709739776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787387922.104289:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14271:1874211709739904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387922.104445:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387922.104493:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387922.104599:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709739904 00000100:00100000:0.0:1787387922.104607:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709739904 00000100:00100000:0.0:1787387922.104659:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787387922.104668:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14271:x1874211709739904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387922.105249:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14271:x1874211709739904:12345-0@lo:502:llog_process_th.0 Request processed in 580us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387922.105257:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387922.105539:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14271:1874211709739904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387922.105572:0:14271:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387922.105582:0:14271:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387922.105584:0:14271:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787387922.105591:0:14271:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d437a1bb000 00000020:00000080:2.0:1787387922.105594:0:14271:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787387922.105604:0:14271:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387922.105606:0:14271:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387922.105608:0:14271:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787387922.105610:0:14271:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387922.105612:0:14271:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387922.105613:0:14271:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787387922.105617:0:14271:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d437a1bb000 00000020:00000080:2.0:1787387922.105619:0:14271:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787387922.105732:0:14271:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387922.105736:0:14271:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387922.105754:0:14271:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787387922.105757:0:14271:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387922.105760:0:14271:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387922.105762:0:14271:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787387922.105765:0:14271:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d437a1bb000 00000020:00000080:2.0:1787387922.105767:0:14271:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787387922.107494:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14271:1874211709740032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387922.107567:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387922.107689:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787387922.116969:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709740032 00000100:00100000:3.0:1787387922.116988:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709740032 00000100:00100000:3.0:1787387922.117044:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787387922.117055:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14271:x1874211709740032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387922.117330:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14271:x1874211709740032:12345-0@lo:502:llog_process_th.0 Request processed in 277us (9762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387922.117338:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387922.126275:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14271:1874211709740032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387922.126323:0:14271:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387922.126332:0:14271:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387922.126335:0:14271:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787387922.126341:0:14271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787387922.127728:0:14227:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787387922.127786:0:14227:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387922.127811:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.127825:0:14227:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387922.127885:0:14227:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787387922.127889:0:14227:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d437a1bb000 10000000:01000000:2.0:1787387922.127891:0:14227:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d437a1bb000 10000000:01000000:2.0:1787387922.127896:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787387922.127903:0:14227:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d437a1bb000 from 1 10000000:01000000:2.0:1787387922.127906:0:14227:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787387922.127945:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fda00/0x93d41aeaa23c870e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.127954:0:14227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d43413fda00/0x93d41aeaa23c870e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.127966:0:14227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d43413fda00/0x93d41aeaa23c870e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387922.127995:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709740160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787387922.128068:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387922.128103:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f6433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387922.128946:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709740160 00000100:00100000:0.0:1787387922.128955:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709740160 00000100:00100000:0.0:1787387922.129009:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387922.129019:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14227:x1874211709740160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787387922.129033:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387922.129050:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4377c71c00/0x93d41aeaa23c8715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c870e expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.129077:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4377c71c00/0x93d41aeaa23c8715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c870e expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.129088:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4377c71c00/0x93d41aeaa23c8715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c870e expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.129097:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71c00, rc 0) 00000100:00100000:0.0:1787387922.129157:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14227:x1874211709740160:12345-0@lo:101:mount.lustre.0 Request processed in 139us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387922.129164:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387922.129233:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709740160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787387922.129256:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d43413fda00/0x93d41aeaa23c870e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8715 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.129264:0:14227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d43413fda00/0x93d41aeaa23c870e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c8715 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387922.129322:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709740288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787387922.129350:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387922.129372:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4360ae29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387922.130341:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709740288 00000100:00100000:0.0:1787387922.130350:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709740288 00000100:00100000:0.0:1787387922.130394:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387922.130403:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14227:x1874211709740288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787387922.130692:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14227:x1874211709740288:12345-0@lo:501:mount.lustre.0 Request processed in 289us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387922.130700:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387922.130770:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709740288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787387922.130815:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709740416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787387922.130857:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387922.130874:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435229d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387922.130889:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709740416 00000100:00100000:0.0:1787387922.130892:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709740416 00000100:00100000:0.0:1787387922.130910:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787387922.130916:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14227:x1874211709740416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787387922.131056:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14227:x1874211709740416:12345-0@lo:503:mount.lustre.0 Request processed in 139us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387922.131075:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787387922.131113:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709740416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787387922.136462:0:14276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14276:1874211709740544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387922.136557:0:14276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387922.139128:0:14276:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43457c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787387922.139331:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709740544 00000100:00100000:0.0:1787387922.139340:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709740544 00000100:00100000:0.0:1787387922.139391:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787387922.139402:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14276:x1874211709740544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387922.140358:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14276:x1874211709740544:12345-0@lo:502:llog_process_th.0 Request processed in 955us (3798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387922.140369:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387922.142556:0:14276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14276:1874211709740544:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787387922.142637:0:14276:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787387922.142658:0:14276:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d43434a8000) 00000020:00000080:3.0:1787387922.142679:0:14276:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787387922.143686:0:14276:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d437a1bb000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787387922.143694:0:14276:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d437a1bb000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787387922.143698:0:14276:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d437a1bb000 4 00010000:00080000:3.0:1787387922.143734:0:14276:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d43746eb800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1787387922.145333:0:14276:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787387922.145437:0:14276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787387922.145493:0:14276:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787387922.145506:0:14276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x93d41aeaa23c8723 00000100:00080000:3.0:1787387922.145517:0:14276:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787387922.145523:0:14276:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d43746eb800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1787387922.145564:0:14276:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437a084380 x1874211709740672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787387922.145593:0:14276:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787387922.145726:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874211709740672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787387922.145824:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387922.149405:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709740672 00000100:00100000:2.0:1787387922.149418:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709740672 00000100:00100000:2.0:1787387922.149459:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387922.149479:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874211709740672:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787387922.149570:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874211709740672:12345-0@lo:38:llog_process_th.0 Request processed in 92us (3745us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787387922.149583:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387922.149632:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787387922.149640:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d43746eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787387922.149644:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787387922.149648:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874211709740672:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787387922.153346:0:14276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14276:1874211709740800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387922.153437:0:14276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387922.153489:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709740800 00000100:00100000:3.0:1787387922.153497:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709740800 00000100:00100000:3.0:1787387922.153543:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387922.153552:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14276:x1874211709740800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387922.153817:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14276:x1874211709740800:12345-0@lo:502:llog_process_th.0 Request processed in 264us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387922.153824:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387922.153869:0:14276:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43457c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387922.153893:0:14276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14276:1874211709740800:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787387922.153917:0:14276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787387922.154302:0:14227:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787387922.154321:0:14227:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787387922.154341:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fda00/0x93d41aeaa23c870e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8715 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.154354:0:14227:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d43413fda00/0x93d41aeaa23c870e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8715 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787387922.154405:0:14227:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787387922.154407:0:14227:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787387922.154408:0:14227:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387922.154410:0:14227:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787387922.154411:0:14227:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387922.154412:0:14227:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387922.154414:0:14227:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787387922.154415:0:14227:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787387922.154417:0:14227:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387922.154419:0:14227:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787387922.154425:0:14227:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787387922.154428:0:14227:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787387922.154429:0:14227:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787387922.154430:0:14227:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387922.154431:0:14227:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787387922.154432:0:14227:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387922.154433:0:14227:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387922.154434:0:14227:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787387922.154435:0:14227:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787387922.154436:0:14227:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387922.154437:0:14227:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787387922.154452:0:14227:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787387922.154477:0:14227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709740928:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787387922.154523:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387922.154547:0:14227:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4360ae29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387922.154729:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709740928 00000100:00100000:2.0:1787387922.154734:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709740928 00000100:00100000:2.0:1787387922.154789:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787387922.154796:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14227:x1874211709740928:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787387922.154830:0:14238:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787387922.154843:0:14238:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787387922.206785:0:14238:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787387922.206806:0:14238:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787387922.208638:0:14261:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787387922.208647:0:14261:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787387922.208691:0:14261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.208711:0:14261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c86f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c86f2 expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.208720:0:14261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.208781:0:14261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c86f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c86f2 expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387922.208796:0:14261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c86f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c86f2 expref: 12 pid: 14238 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387922.208811:0:14261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14261:1874211709741056:0@lo:104: 00000100:00100000:0.0:1787387922.208875:0:14261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387922.208937:0:14261:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43438dec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387922.209034:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709741056 00000100:00100000:3.0:1787387922.209043:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709741056 00000100:00100000:3.0:1787387922.209093:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387922.209102:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+3:14261:x1874211709741056:12345-0@lo:104: 00010000:00010000:3.0:1787387922.209114:0:14228:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387922.209168:0:14228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387922.209174:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+3:14261:x1874211709741056:12345-0@lo:104: Request processed in 73us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387922.209180:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387922.209217:0:14261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14261:1874211709741056:0@lo:104: 00010000:00010000:3.0:1787387922.209235:0:14261:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387922.209905:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387922.209913:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387922.209920:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd200 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:3.0:1787387922.209924:0:14234:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387922.209933:0:14234:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387922.209941:0:14234:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387922.209947:0:14234:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387922.209998:0:14234:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387922.210004:0:14234:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387922.210026:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387922.210032:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d43413fd200/0x93d41aeaa23c86f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c86f9 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387922.210049:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387922.210050:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387922.210052:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387922.210079:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709741184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387922.210116:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387922.210818:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709741184 00000100:00100000:2.0:1787387922.210827:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709741184 00010000:00010000:2.0:1787387922.210852:0:14230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c86f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c86f2 expref: 13 pid: 14238 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387922.210876:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387922.210883:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+13:3311:x1874211709741184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787387922.210893:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387922.210897:0:14230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c86f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c86f2 expref: 13 pid: 14238 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.210908:0:14230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c86f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c86f2 expref: 13 pid: 14238 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.210925:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c86f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c86f2 expref: 13 pid: 14238 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.210947:0:14230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.210955:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787387922.210970:0:14230:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002323608s 00010000:00010000:2.0:1787387922.210974:0:14230:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.210981:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.210988:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.210994:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.210999:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70800 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387922.211004:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.211010:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.211023:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.211033:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387922.211079:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:3311:x1874211709741184:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387922.211086:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387922.211136:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709741184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787387922.211159:0:14261:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.211167:0:14261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387922.211173:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c872a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387922.223434:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14227:x1874211709740928:12345-0@lo:253:mount.lustre.0 Request processed in 68562us (68834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387922.223486:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787387922.223579:0:14227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14227:1874211709740928:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787387922.223595:0:14227:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787387922.223598:0:14227:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787387922.223600:0:14227:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787387922.223601:0:14227:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387922.223602:0:14227:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787387922.223603:0:14227:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387922.223605:0:14227:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387922.223607:0:14227:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787387922.223608:0:14227:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787387922.223610:0:14227:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387922.223611:0:14227:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787387922.223638:0:14227:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787387922.228050:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787387922.228229:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787387922.228606:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787387922.228812:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787387922.229088:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787387922.229250:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787387922.230895:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787387922.231066:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787387922.231326:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787387922.231638:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787387922.232008:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787387922.232179:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787387922.266070:0:14227:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787387922.266577:0:14227:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787387922.266941:0:14283:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787387922.267014:0:14283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787387922.269607:0:14227:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787387922.269784:0:14227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787387922.270217:0:14227:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787387922.270225:0:14227:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787387922.272034:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787387922.272114:0:14283:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787387922.272118:0:14283:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:1.0:1787387922.272479:0:14282:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787387922.272484:0:14282:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1787387922.272865:0:14227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387922.273941:0:14227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787387922.274519:0:14227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787387922.274554:0:14227:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787387922.276254:0:14227:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1787387922.281693:0:14227:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787387922.312279:0:14227:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787387922.312322:0:14227:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb034c191b988 00100000:10000000:1.0:1787387922.312331:0:14227:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787387922.313226:0:14227:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787387922.313242:0:14227:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787387922.313257:0:14227:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787387922.313273:0:14227:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787387922.910415:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787387923.166524:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787387923.293840:0:14243:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787387923.293849:0:14243:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d437a1bb000 from 6 10000000:01000000:1.0:1787387923.293855:0:14243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787387923.293901:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387923.293914:0:14243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387923.293926:0:14243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387923.293965:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709741312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787387923.294041:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387923.294089:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43451cb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787387923.294914:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709741312 00000100:00100000:3.0:1787387923.294924:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709741312 00000100:00100000:3.0:1787387923.295044:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787387923.295054:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14243:x1874211709741312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387923.295069:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387923.295088:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d437460a000/0x93d41aeaa23c8738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c8731 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387923.295113:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d437460a000/0x93d41aeaa23c8738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c8731 expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387923.295123:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d437460a000/0x93d41aeaa23c8738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8731 expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387923.295140:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a000, rc 0) 00000100:00100000:3.0:1787387923.295406:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14243:x1874211709741312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 353us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387923.295414:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787387923.295526:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709741312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387923.295543:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387923.295553:0:14243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387923.295616:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709741440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787387923.295652:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387923.295682:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43451cb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787387923.295927:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709741440 00000100:00100000:3.0:1787387923.295933:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709741440 00000100:00100000:3.0:1787387923.296465:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787387923.296476:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14243:x1874211709741440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787387923.296495:0:14238:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787387923.296512:0:14238:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787387923.296515:0:14238:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787387923.296609:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14243:x1874211709741440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387923.296617:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787387923.297133:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709741440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787387923.297183:0:14243:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787387923.297191:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387923.297201:0:14243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387923.934924:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787387924.196637:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787387924.964677:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387925.981995:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387927.006437:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787387927.028821:0:14526:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787387927.645946:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787387927.645954:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787387927.645957:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787387927.645961:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787387927.645963:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787387927.645966:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787387927.645970:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d43746eb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787387927.645981:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d43746eb800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1787387927.646026:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437a087480 x1874211709741696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787387927.646063:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387927.646080:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709741568:0@lo:400:kworker.0 00000100:00100000:3.0:1787387927.646155:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387927.646214:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874211709741696:0@lo:38:kworker.0 00000100:00100000:3.0:1787387927.646248:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387927.646290:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709741568 00000100:00100000:3.0:1787387927.646298:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709741568 00000100:00100000:3.0:1787387927.646700:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387927.646713:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:3311:x1874211709741568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387927.647542:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:3311:x1874211709741568:12345-0@lo:400:kworker.0 Request processed in 828us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387927.647553:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387927.647676:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709741696 00000100:00100000:3.0:1787387927.647684:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709741696 00000100:00100000:3.0:1787387927.647707:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387927.647712:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874211709741696:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787387927.647768:0:14247:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:3.0:1787387927.647806:0:14247:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x93d41aeaa23c873f 00000004:00100000:3.0:1787387927.647823:0:14247:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787387927.647956:0:14247:0:(import.c:65:import_set_state_nolock()) ffff8d43622f9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787387927.648015:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874211709741696:12345-0@lo:38:kworker.0 Request processed in 301us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387927.648021:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787387927.648059:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d437a087480 x1874211709741696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787387927.648085:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787387927.648093:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787387927.648098:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787387927.648101:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d43746eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787387927.648107:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874211709741696:0@lo:38:kworker.0 00000100:00100000:1.0:1787387927.657408:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709741568:0@lo:400:kworker.0 00010000:00010000:3.0:1787387928.032367:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387929.054154:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787387930.045138:0:14677:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffdb0921440 00000020:00000080:0.0:1787387930.045153:0:14677:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787387930.045157:0:14677:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787387930.045164:0:14677:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb09236d0 20000000:00000080:0.0:1787387930.045170:0:14677:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d4376197000 uarg=0000000000000000 20000000:01000000:0.0:1787387930.045201:0:14677:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787387930.045208:0:14677:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787387930.045212:0:14677:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787387930.047252:0:14678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787387930.047407:0:14677:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787387930.060002:0:14677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787387930.061112:0:14677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387930.061135:0:14677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4377c70000/0x93d41aeaa23c8707 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8700 expref: 11 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387930.061143:0:14677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387930.061187:0:14677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4377c70000/0x93d41aeaa23c8707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c8700 expref: 11 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387930.061200:0:14677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4377c70000/0x93d41aeaa23c8707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c8700 expref: 11 pid: 14239 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387930.061226:0:14677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14677:1874211709741824:0@lo:104: 00000100:00100000:0.0:1787387930.061293:0:14677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387930.061383:0:14677:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387930.061577:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709741824 00000100:00100000:2.0:1787387930.061587:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709741824 00000100:00100000:2.0:1787387930.061651:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787387930.061662:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+3:14677:x1874211709741824:12345-0@lo:104: 00010000:00010000:2.0:1787387930.061677:0:14229:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387930.061917:0:14229:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387930.061925:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+3:14677:x1874211709741824:12345-0@lo:104: Request processed in 265us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387930.061933:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787387930.063513:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387930.063525:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.063535:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fde00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:3.0:1787387930.063539:0:14234:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.063549:0:14234:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387930.063557:0:14234:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387930.063563:0:14234:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787387930.063607:0:14234:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.063613:0:14234:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387930.063639:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.063659:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c8700 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.063679:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387930.063681:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387930.063683:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387930.064635:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3313:1874211709741952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387930.064705:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387930.065025:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709741952 00000100:00100000:3.0:1787387930.065033:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709741952 00010000:00010000:3.0:1787387930.065063:0:14230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4377c70000/0x93d41aeaa23c8707 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c8700 expref: 12 pid: 14239 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387930.065183:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387930.065192:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:3313:x1874211709741952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787387930.065206:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387930.065212:0:14230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4377c70000/0x93d41aeaa23c8707 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c8700 expref: 12 pid: 14239 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.065224:0:14230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4377c70000/0x93d41aeaa23c8707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c8700 expref: 12 pid: 14239 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.065247:0:14230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.065257:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.065271:0:14230:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.065288:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.065294:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.065300:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.065306:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387930.065321:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.065329:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.065338:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387930.065347:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387930.065391:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:3313:x1874211709741952:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387930.065398:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387930.065449:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3313:1874211709741952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787387930.066527:0:14677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4377c70000/0x93d41aeaa23c8707 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c8700 expref: 11 pid: 14239 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387930.066564:0:14677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14677:1874211709741824:0@lo:104: 00010000:00010000:1.0:1787387930.066585:0:14677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387930.066595:0:14677:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387930.066602:0:14677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387930.066608:0:14677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4377c70400/0x93d41aeaa23c8746 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387930.080602:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387931.105213:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787387931.935852:0:14243:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787387931.935858:0:14243:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d437a1bb000 from 10 10000000:01000000:3.0:1787387931.935862:0:14243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787387931.935910:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387931.936010:0:14243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387931.936090:0:14243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387931.936118:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709742080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787387931.936640:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387931.936689:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373f1b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387931.936820:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709742080 00000100:00100000:2.0:1787387931.936828:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709742080 00000100:00100000:2.0:1787387931.936876:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787387931.936885:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+11:14243:x1874211709742080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387931.936899:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387931.937156:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43413fce00/0x93d41aeaa23c8754 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c874d expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387931.937257:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43413fce00/0x93d41aeaa23c8754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c874d expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387931.937268:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43413fce00/0x93d41aeaa23c8754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c874d expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387931.937301:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fce00, rc 0) 00000100:00100000:2.0:1787387931.937397:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14243:x1874211709742080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 513us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387931.937405:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387931.937948:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709742080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387931.937968:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387931.937977:0:14243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387931.938042:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709742208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387931.938077:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387931.938100:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351754d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787387931.938149:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709742208 00000100:00100000:3.0:1787387931.938155:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709742208 00000100:00100000:3.0:1787387931.938203:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787387931.938211:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14243:x1874211709742208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387931.938459:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14243:x1874211709742208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387931.938466:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787387931.938499:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709742208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387931.938525:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709742336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387931.938561:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387931.938576:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373f1b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787387931.938588:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709742336 00000100:00100000:3.0:1787387931.938591:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709742336 00000100:00100000:3.0:1787387931.938612:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787387931.938618:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14243:x1874211709742336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387931.938769:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14243:x1874211709742336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387931.938782:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787387931.938816:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709742336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787387931.939352:0:14751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787387931.939399:0:14243:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787387931.939416:0:14243:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787387931.939427:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387931.939437:0:14243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387932.126628:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787387932.767552:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787387932.767560:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787387932.767564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787387932.767569:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787387932.767619:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709742592:0@lo:400:kworker.0 00000100:00100000:1.0:1787387932.767698:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387932.767822:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709742592 00000100:00100000:1.0:1787387932.767830:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709742592 00000100:00100000:3.0:1787387932.767886:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3314:1874211709742464:0@lo:400:kworker.0 00000100:00100000:1.0:1787387932.767886:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387932.767905:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709742592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387932.768027:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787387922/real 1787387922] req@ffff8d437a820380 x1874211709739008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787387932 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387932.768050:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d437a820380 x1874211709739008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787387932 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387932.768059:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787387922/real 1787387922] req@ffff8d437ab46300 x1874211709738880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787387932 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387932.768071:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d437ab46300 x1874211709738880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787387932 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787387932.768084:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d437428e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787387932.768097:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787387932.768101:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709739008:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787387932.768106:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4377cb8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787387932.768111:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787387932.768124:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709738880:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787387932.768148:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787387932.768151:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787387932.768154:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d4377cb8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787387932.768158:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:0.0:1787387932.768162:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787387932.768166:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d4377cb8800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1787387932.768185:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437ab46300 x1874211709742720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787387932.768196:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787387932.768200:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787387932.768201:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d437428e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787387932.768205:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:0.0:1787387932.768207:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787387932.768210:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d437428e000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1787387932.768219:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437ab45c00 x1874211709742848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787387932.768236:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709742720:0@lo:8:kworker.0 00000100:00100000:3.0:1787387932.776384:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387932.776408:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709742592:12345-0@lo:400:kworker.0 Request processed in 8495us (8700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387932.776444:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787387932.776553:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d437a820700 x1874211709742592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387932.776569:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709742592:0@lo:400:kworker.0 00000400:00000100:0.0:1787387932.776697:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211709742720 offset 0 length 520: 4 00000100:00100000:0.0:1787387932.776761:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709742848:0@lo:8:kworker.0 00000400:00000100:0.0:1787387932.776795:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211709742848 offset 0 length 520: 4 00000100:00100000:3.0:1787387932.777027:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709742464 00000100:00100000:3.0:1787387932.777039:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709742464 00000100:00100000:3.0:1787387932.777117:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787387932.777130:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:3314:x1874211709742464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387932.777220:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:3314:x1874211709742464:12345-0@lo:400:kworker.0 Request processed in 90us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387932.777227:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787387932.777323:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3314:1874211709742464:0@lo:400:kworker.0 00010000:00010000:0.0:1787387933.150661:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387934.175763:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787387934.282011:0:14878:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787387934.282015:0:14878:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787387934.282447:0:14878:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d4342bed800 00000020:01000004:2.0:1787387934.282568:0:14878:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787387934.282581:0:14878:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787387934.282595:0:14878:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d4345180000) 00000020:00000080:2.0:1787387934.282610:0:14878:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787387934.310300:0:14878:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787387934.310910:0:14878:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787387934.312133:0:14878:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787387934.312550:0:14878:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787387934.312970:0:14878:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787387934.313578:0:14878:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1787387934.313773:0:14878:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1787387934.313868:0:14878:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1787387934.314691:0:14878:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 607: rc = 0 00100000:10000000:0.0:1787387934.315047:0:14878:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 607: rc = 0 00100000:10000000:0.0:1787387934.315822:0:14878:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 607: rc = 0 00100000:10000000:0.0:1787387934.316162:0:14878:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 607: rc = 0 00100000:10000000:0.0:1787387934.316577:0:14878:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 607: rc = 0 00100000:10000000:0.0:1787387934.317015:0:14878:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 607: rc = 0 00000020:00000080:0.0:1787387934.317918:0:14878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787387934.317929:0:14878:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787387934.317940:0:14878:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x93d41aeaa23c8762 00000020:01000004:0.0:1787387934.317949:0:14878:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787387934.317969:0:14878:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787387934.317972:0:14878:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787387934.317977:0:14878:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787387934.317981:0:14878:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787387934.317991:0:14878:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d4242c9b380) 00000020:00000080:0.0:1787387934.318000:0:14878:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787387934.319504:0:14878:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787387934.319867:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787387934.319874:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787387934.320895:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787387934.320905:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787387934.321397:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787387934.321404:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787387934.328040:0:14878:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387934.329047:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787387934.329128:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787387934.332887:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787387934.337082:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787387934.364395:0:14878:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787387934.364892:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787387934.364899:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787387934.366202:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787387934.366213:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787387934.367264:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787387934.367273:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787387934.370701:0:14878:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387934.371087:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787387934.371093:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787387934.373240:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787387934.373252:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787387934.425326:0:14878:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787387934.425517:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787387934.425523:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787387934.428297:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787387934.428309:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787387934.430789:0:14878:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787387934.430814:0:14878:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787387934.430820:0:14878:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:00080000:0.0:1787387934.431424:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:01000000:3.0:1787387934.437944:0:14878:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787387934.437989:0:14878:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787387934.437994:0:14878:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787387934.437995:0:14878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787387934.437997:0:14878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387934.437998:0:14878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387934.437999:0:14878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387934.438000:0:14878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387934.438001:0:14878:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787387934.438003:0:14878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387934.438004:0:14878:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787387934.438007:0:14878:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787387934.438009:0:14878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787387934.438011:0:14878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787387934.438012:0:14878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387934.438013:0:14878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387934.438014:0:14878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387934.438015:0:14878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387934.438016:0:14878:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787387934.438017:0:14878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387934.438018:0:14878:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787387934.438044:0:14878:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787387934.438063:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709742976:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787387934.438129:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387934.438245:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda000 going to sleep for 11 seconds 00000100:00100000:0.0:1787387934.438288:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709742976 00000100:00100000:0.0:1787387934.438296:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709742976 00000100:00100000:0.0:1787387934.438380:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787387934.438390:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14878:x1874211709742976:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787387934.438422:0:14238:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787387934.438425:0:14238:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787387934.438428:0:14238:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787387934.448259:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14878:x1874211709742976:12345-0@lo:253:mount.lustre.0 Request processed in 9860us (10119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387934.448275:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787387934.448440:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709742976:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787387934.448455:0:14878:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787387934.448458:0:14878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787387934.448460:0:14878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387934.448461:0:14878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387934.448462:0:14878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387934.448463:0:14878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387934.448465:0:14878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387934.448466:0:14878:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387934.448468:0:14878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387934.448530:0:14878:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787387934.448552:0:14878:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d4342bed800 from lustre-OST0000 10000000:01000000:1.0:1787387934.448578:0:14878:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787387934.448581:0:14878:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787387934.448587:0:14878:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d4345184d40 local copy 00010000:00010000:1.0:1787387934.448597:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c865f expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387934.448856:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787387934.448900:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387934.448940:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435229d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787387934.449218:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709743104 00000100:00100000:2.0:1787387934.449235:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709743104 00000100:00100000:2.0:1787387934.449287:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787387934.449296:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14878:x1874211709743104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787387934.449459:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14878:x1874211709743104:12345-0@lo:501:mount.lustre.0 Request processed in 163us (557us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387934.449467:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787387934.449611:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743104:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787387934.449625:0:14878:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787387934.449782:0:14878:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787387934.449791:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c865f expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.449801:0:14878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c865f expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387934.449825:0:14878:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d4342bed800 10000000:01000000:1.0:1787387934.449831:0:14878:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787387934.449835:0:14878:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d4345184d40 10000000:01000000:1.0:1787387934.449837:0:14878:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787387934.449841:0:14878:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8d4345184d40 from 1 10000000:01000000:1.0:1787387934.449844:0:14878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787387934.449869:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c8770 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.449877:0:14878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c8770 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.449885:0:14878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c8770 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387934.449899:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787387934.449926:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387934.449963:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435229d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787387934.450298:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709743232 00000100:00100000:2.0:1787387934.450304:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709743232 00000100:00100000:2.0:1787387934.450339:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787387934.450347:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+12:14878:x1874211709743232:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787387934.450357:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387934.450371:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43413fd600/0x93d41aeaa23c8777 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c8770 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387934.450404:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43413fd600/0x93d41aeaa23c8777 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c8770 expref: 13 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387934.450413:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43413fd600/0x93d41aeaa23c8777 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8770 expref: 13 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387934.450423:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fd600, rc 0) 00000100:00100000:2.0:1787387934.450453:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+13:14878:x1874211709743232:12345-0@lo:101:mount.lustre.0 Request processed in 107us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387934.450459:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387934.450716:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787387934.450730:0:14878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c8770 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8777 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.450862:0:14878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c8770 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c8777 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387934.450879:0:14878:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787387934.450926:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c8770 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8777 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.450934:0:14878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d434152f600/0x93d41aeaa23c8770 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8777 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387934.450941:0:14878:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787387934.450946:0:14878:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387934.450950:0:14878:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787387934.450953:0:14878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787387934.450968:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c877e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.450975:0:14878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c877e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.450982:0:14878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c877e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387934.450996:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787387934.451026:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387934.451063:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435229d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787387934.451272:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709743360 00000100:00100000:0.0:1787387934.451278:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709743360 00000100:00100000:0.0:1787387934.451316:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787387934.451324:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+13:14878:x1874211709743360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787387934.451333:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387934.451345:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c8785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c877e expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.451370:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c8785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c877e expref: 14 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.451379:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4377c70800/0x93d41aeaa23c8785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c877e expref: 14 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.451386:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70800, rc 0) 00000100:00100000:0.0:1787387934.451423:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+14:14878:x1874211709743360:12345-0@lo:101:mount.lustre.0 Request processed in 100us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387934.451429:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787387934.451773:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787387934.451785:0:14878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c877e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8785 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.451793:0:14878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c877e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c8785 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787387934.452386:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787387934.454268:0:14878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387934.458940:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787387934.459032:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787387934.459066:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787387934.459247:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787387934.459290:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787387934.459326:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787387934.459403:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787387934.459412:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787387934.459683:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787387934.460070:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387934.460157:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437f643480 going to sleep for 11 seconds 00000100:00100000:1.0:1787387934.462989:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709743488 00000100:00100000:1.0:1787387934.463004:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709743488 00000100:00100000:1.0:1787387934.463064:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787387934.463074:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+14:14878:x1874211709743488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787387934.463889:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+14:14878:x1874211709743488:12345-0@lo:501:mount.lustre.0 Request processed in 814us (3816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387934.463898:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787387934.464858:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787387934.464919:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787387934.464983:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387934.465022:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43452e4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787387934.465577:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709743616 00000100:00100000:3.0:1787387934.465585:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709743616 00000100:00100000:3.0:1787387934.465638:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787387934.465647:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+14:14878:x1874211709743616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787387934.466066:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+14:14878:x1874211709743616:12345-0@lo:503:mount.lustre.0 Request processed in 419us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387934.466074:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787387934.466250:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743616:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787387934.467054:0:14878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787387934.467418:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787387934.472079:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387934.472195:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435080d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787387934.474626:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709743744 00000100:00100000:0.0:1787387934.474643:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709743744 00000100:00100000:0.0:1787387934.474760:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787387934.474772:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+14:14878:x1874211709743744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787387934.475101:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+14:14878:x1874211709743744:12345-0@lo:502:mount.lustre.0 Request processed in 330us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387934.475120:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787387934.478857:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787387934.479168:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787387934.479249:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787387934.479288:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787387934.479337:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787387934.479376:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787387934.479427:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787387934.479514:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787387934.479554:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787387934.479586:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787387934.479647:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787387934.479684:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787387934.479775:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787387934.479822:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787387934.479900:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387934.480972:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709743872 00000100:00100000:1.0:1787387934.480982:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709743872 00000100:00100000:1.0:1787387934.481027:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787387934.481036:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+14:14878:x1874211709743872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787387934.481281:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+14:14878:x1874211709743872:12345-0@lo:502:mount.lustre.0 Request processed in 245us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387934.481289:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387934.481394:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43452e4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387934.481434:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709743872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787387934.482042:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787387934.482059:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787387934.483119:0:14892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787387934.483128:0:14892:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787387934.483135:0:14892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387934.483137:0:14892:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787387934.483143:0:14892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787387934.483159:0:14892:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d43451819c0) 00000020:00000080:2.0:1787387934.483180:0:14892:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787387934.483186:0:14892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787387934.483262:0:14892:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d4342bed800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787387934.483269:0:14892:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787387934.483277:0:14892:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x93d41aeaa23c8793 00010000:00010000:2.0:1787387934.488824:0:14892:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787387934.489259:0:14892:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787387934.492120:0:14892:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787387934.493667:0:14892:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787387934.493688:0:14892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387934.493695:0:14892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387934.493697:0:14892:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787387934.493700:0:14892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787387934.493703:0:14892:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787387934.493704:0:14892:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787387934.493706:0:14892:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787387934.493707:0:14892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787387934.493710:0:14892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387934.493711:0:14892:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787387934.493713:0:14892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387934.493716:0:14892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387934.493717:0:14892:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787387934.493720:0:14892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787387934.493722:0:14892:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787387934.493725:0:14892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387934.493727:0:14892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387934.493728:0:14892:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787387934.493731:0:14892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387934.493733:0:14892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387934.493735:0:14892:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787387934.493776:0:14892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787387934.493840:0:14892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387934.493844:0:14892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387934.493846:0:14892:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787387934.493849:0:14892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787387934.494108:0:14878:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787387934.494140:0:14878:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787387934.494162:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c877e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8785 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.494185:0:14878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d434152ee00/0x93d41aeaa23c877e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8785 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387934.494194:0:14878:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4342bed800 from 1 10000000:01000000:1.0:1787387934.494196:0:14878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787387934.494242:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.494251:0:14878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.494261:0:14878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387934.494286:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787387934.494358:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387934.494409:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a7003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387934.494484:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709744000 00000100:00100000:2.0:1787387934.494491:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709744000 00000100:00100000:2.0:1787387934.494539:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787387934.494549:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+14:14878:x1874211709744000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787387934.494570:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387934.494583:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c87a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c879a expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387934.494605:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c87a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c879a expref: 15 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387934.494615:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c87a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c879a expref: 15 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387934.494624:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d43413fd200, rc 0) 00000100:00100000:2.0:1787387934.494662:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14878:x1874211709744000:12345-0@lo:101:mount.lustre.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387934.494669:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787387934.494823:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787387934.494840:0:14878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.494849:0:14878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787387934.495315:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787387934.495697:0:14878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387934.496721:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787387934.496814:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787387934.496898:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787387934.496907:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787387934.496992:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787387934.497047:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387934.497082:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a7003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387934.497303:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709744128 00000100:00100000:2.0:1787387934.497310:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709744128 00000100:00100000:2.0:1787387934.497344:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787387934.497352:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14878:x1874211709744128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787387934.497578:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14878:x1874211709744128:12345-0@lo:501:mount.lustre.0 Request processed in 226us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387934.497585:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787387934.497767:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787387934.497800:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787387934.497834:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387934.497857:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d437a7003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387934.497993:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709744256 00000100:00100000:2.0:1787387934.497998:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709744256 00000100:00100000:2.0:1787387934.498027:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787387934.498034:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14878:x1874211709744256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787387934.498177:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14878:x1874211709744256:12345-0@lo:503:mount.lustre.0 Request processed in 142us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387934.498195:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787387934.498272:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787387934.498717:0:14878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787387934.498816:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787387934.498860:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387934.498889:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda540 going to sleep for 11 seconds 00000100:00100000:2.0:1787387934.499024:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709744384 00000100:00100000:2.0:1787387934.499029:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709744384 00000100:00100000:2.0:1787387934.499057:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787387934.499063:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14878:x1874211709744384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787387934.499206:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14878:x1874211709744384:12345-0@lo:502:mount.lustre.0 Request processed in 141us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387934.499212:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787387934.499307:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787387934.499608:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787387934.499659:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787387934.499710:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787387934.499931:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787387934.499971:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787387934.500021:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787387934.500071:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787387934.500105:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787387934.500139:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787387934.500190:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387934.500271:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347dda540 going to sleep for 11 seconds 00000100:00100000:2.0:1787387934.504596:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709744512 00000100:00100000:2.0:1787387934.504610:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709744512 00000100:00100000:2.0:1787387934.505592:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787387934.505613:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14878:x1874211709744512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787387934.505903:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14878:x1874211709744512:12345-0@lo:502:mount.lustre.0 Request processed in 295us (5711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387934.505911:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787387934.506156:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787387934.506332:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787387934.506349:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787387934.508293:0:14896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387934.508308:0:14896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387934.508310:0:14896:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787387934.508317:0:14896:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4342bed800 00000020:00000080:0.0:1787387934.508320:0:14896:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787387934.508326:0:14896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387934.508329:0:14896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387934.508330:0:14896:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787387934.508333:0:14896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387934.508335:0:14896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387934.508336:0:14896:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787387934.508339:0:14896:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4342bed800 00000020:00000080:0.0:1787387934.508340:0:14896:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787387934.508390:0:14896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387934.508393:0:14896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387934.508394:0:14896:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787387934.508396:0:14896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387934.508398:0:14896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387934.508399:0:14896:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787387934.508403:0:14896:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4342bed800 00000020:00000080:0.0:1787387934.508405:0:14896:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787387934.508438:0:14896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387934.508442:0:14896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387934.508443:0:14896:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787387934.508446:0:14896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787387934.509614:0:14878:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787387934.509647:0:14878:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387934.509679:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.509692:0:14878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387934.509758:0:14878:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787387934.509761:0:14878:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d4342bed800 10000000:01000000:0.0:1787387934.509764:0:14878:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d4342bed800 10000000:01000000:0.0:1787387934.509768:0:14878:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787387934.509775:0:14878:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4342bed800 from 1 10000000:01000000:0.0:1787387934.509777:0:14878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787387934.509814:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4377c70a00/0x93d41aeaa23c87a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.509822:0:14878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4377c70a00/0x93d41aeaa23c87a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.509832:0:14878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4377c70a00/0x93d41aeaa23c87a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387934.509856:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787387934.509923:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387934.512276:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43451cb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387934.512476:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709744640 00000100:00100000:3.0:1787387934.512486:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709744640 00000100:00100000:3.0:1787387934.512551:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787387934.512561:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14878:x1874211709744640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787387934.512578:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387934.512609:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d437460b600/0x93d41aeaa23c87af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c87a8 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387934.512636:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d437460b600/0x93d41aeaa23c87af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c87a8 expref: 16 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387934.512647:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d437460b600/0x93d41aeaa23c87af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c87a8 expref: 16 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387934.512657:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460b600, rc 0) 00000100:00100000:3.0:1787387934.512722:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14878:x1874211709744640:12345-0@lo:101:mount.lustre.0 Request processed in 162us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387934.512729:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787387934.514632:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787387934.514657:0:14878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4377c70a00/0x93d41aeaa23c87a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87af expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.514669:0:14878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4377c70a00/0x93d41aeaa23c87a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c87af expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787387934.515323:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787387934.515836:0:14878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387934.516081:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787387934.516126:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787387934.516161:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787387934.516212:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787387934.516263:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787387934.516307:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787387934.516340:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787387934.516370:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787387934.516418:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787387934.516455:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787387934.516489:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787387934.516539:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787387934.516573:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787387934.516624:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787387934.516676:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787387934.516712:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787387934.516768:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787387934.516834:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787387934.516874:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787387934.516909:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787387934.516958:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787387934.516995:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787387934.517028:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787387934.517100:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787387934.517139:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787387934.517174:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787387934.517232:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787387934.517271:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787387934.517347:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787387934.517363:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787387934.520295:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787387934.520368:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387934.520412:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43451cb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387934.520874:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709744768 00000100:00100000:3.0:1787387934.520883:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709744768 00000100:00100000:3.0:1787387934.520942:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787387934.520951:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14878:x1874211709744768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787387934.521219:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14878:x1874211709744768:12345-0@lo:501:mount.lustre.0 Request processed in 268us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387934.521238:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787387934.521773:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787387934.521817:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787387934.521857:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387934.521884:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43451cb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387934.521943:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709744896 00000100:00100000:1.0:1787387934.521949:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709744896 00000100:00100000:1.0:1787387934.521988:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787387934.521995:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14878:x1874211709744896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787387934.522141:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14878:x1874211709744896:12345-0@lo:503:mount.lustre.0 Request processed in 146us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387934.522148:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787387934.522189:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709744896:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787387934.522684:0:14878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787387934.522774:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a822d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709745024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787387934.522815:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387934.522841:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709745024 00000100:00100000:1.0:1787387934.522845:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709745024 00000100:00100000:1.0:1787387934.522865:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787387934.522871:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14878:x1874211709745024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787387934.523019:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14878:x1874211709745024:12345-0@lo:502:mount.lustre.0 Request processed in 147us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387934.523033:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787387934.523063:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4345c0bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387934.523076:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a822d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709745024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787387934.523300:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787387934.523346:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787387934.523379:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787387934.523426:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787387934.523461:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787387934.523506:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787387934.523543:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787387934.523577:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787387934.523620:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787387934.523670:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787387934.523706:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787387934.523777:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787387934.523813:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787387934.523846:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787387934.523896:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787387934.524039:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787387934.524075:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787387934.524122:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787387934.524155:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787387934.524187:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787387934.524245:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787387934.524282:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787387934.524310:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787387934.524351:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787387934.524382:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787387934.524429:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787387934.524476:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787387934.524521:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787387934.524552:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787387934.524594:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787387934.524623:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787387934.524652:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787387934.524683:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787387934.524727:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787387934.528122:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787387934.528262:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787387934.528300:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787387934.528331:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787387934.528373:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787387934.528402:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787387934.528448:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a822d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709745152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787387934.528526:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387934.528633:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4345c0bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387934.534731:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709745152 00000100:00100000:0.0:1787387934.534767:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709745152 00000100:00100000:0.0:1787387934.534824:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787387934.534835:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14878:x1874211709745152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787387934.535132:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14878:x1874211709745152:12345-0@lo:502:mount.lustre.0 Request processed in 298us (6604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387934.535140:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787387934.535309:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a822d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709745152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787387934.535410:0:14878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787387934.535425:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787387934.538304:0:14901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787387934.538322:0:14901:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d4345183380) 00000020:00000080:2.0:1787387934.538345:0:14901:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787387934.538502:0:14901:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d4342bed800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787387934.538506:0:14901:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4342bed800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787387934.538509:0:14901:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4342bed800 3 00010000:00080000:2.0:1787387934.538538:0:14901:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4351458800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.159@tcp at head 00010000:00010000:2.0:1787387934.540147:0:14901:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787387934.540269:0:14901:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787387934.540307:0:14901:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787387934.540318:0:14901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x93d41aeaa23c87bd 00000100:00080000:2.0:1787387934.540328:0:14901:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387934.540342:0:14901:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d4351458800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1787387934.540379:0:14901:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437a748000 x1874211709745280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387934.540402:0:14901:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787387934.540438:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787387934.540442:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787387934.540445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787387934.540448:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787387934.544413:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709745408:0@lo:400:kworker.0 00000100:00100000:1.0:1787387934.544495:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387934.547791:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709745408 00000100:00100000:3.0:1787387934.547806:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709745408 00000100:00100000:3.0:1787387934.547866:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387934.547877:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709745408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387934.547976:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709745408:12345-0@lo:400:kworker.0 Request processed in 102us (3482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387934.547984:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787387934.548034:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d437a74b800 x1874211709745408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387934.548050:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709745408:0@lo:400:kworker.0 00000100:00100000:0.0:1787387934.548509:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874211709745280:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787387934.548556:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387934.548732:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709745280 00000100:00100000:3.0:1787387934.548935:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709745280 00000100:00100000:3.0:1787387934.548964:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387934.548970:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874211709745280:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787387934.548994:0:14247:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:3.0:1787387934.549040:0:14247:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x93d41aeaa23c87c4 00000004:00100000:3.0:1787387934.549054:0:14247:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787387934.549082:0:14247:0:(import.c:65:import_set_state_nolock()) ffff8d4358462000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787387934.549125:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874211709745280:12345-0@lo:38:llog_process_th.0 Request processed in 152us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387934.549138:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787387934.549216:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d437a748000 x1874211709745280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387934.549237:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787387934.549243:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787387934.549252:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787387934.549257:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787387934.549259:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4351458800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787387934.549266:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874211709745280:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787387934.550179:0:14901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787387934.550242:0:14878:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787387934.550271:0:14878:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787387934.550284:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4377c70a00/0x93d41aeaa23c87a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87af expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.550294:0:14878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4377c70a00/0x93d41aeaa23c87a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87af expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787387934.550335:0:14878:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787387934.550336:0:14878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787387934.550338:0:14878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387934.550339:0:14878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787387934.550340:0:14878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387934.550341:0:14878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387934.550343:0:14878:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787387934.550344:0:14878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387934.550346:0:14878:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787387934.550350:0:14878:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787387934.550352:0:14878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787387934.550353:0:14878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787387934.550354:0:14878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387934.550355:0:14878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787387934.550356:0:14878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387934.550357:0:14878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387934.550358:0:14878:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787387934.550359:0:14878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387934.550360:0:14878:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787387934.550383:0:14878:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787387934.550402:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709745536:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787387934.550461:0:14878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387934.550574:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709745536 00000100:00100000:3.0:1787387934.550580:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709745536 00000100:00100000:3.0:1787387934.550615:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787387934.550622:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14878:x1874211709745536:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787387934.550644:0:14238:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787387934.550657:0:14238:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787387934.551121:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43451cbcc0 going to sleep for 11 seconds 20000000:01000000:0.0:1787387934.586257:0:14238:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787387934.586312:0:14238:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787387934.586380:0:14261:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787387934.586385:0:14261:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787387934.586409:0:14261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387934.586430:0:14261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d437460a000/0x93d41aeaa23c8738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8731 expref: 16 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387934.586439:0:14261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387934.586480:0:14261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d437460a000/0x93d41aeaa23c8738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c8731 expref: 16 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387934.586493:0:14261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d437460a000/0x93d41aeaa23c8738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c8731 expref: 16 pid: 14239 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387934.586507:0:14261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14261:1874211709745664:0@lo:104: 00000100:00100000:2.0:1787387934.586573:0:14261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387934.586760:0:14261:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4344ef59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387934.586875:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709745664 00000100:00100000:3.0:1787387934.586883:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709745664 00000100:00100000:3.0:1787387934.586970:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387934.586980:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+3:14261:x1874211709745664:12345-0@lo:104: 00010000:00010000:3.0:1787387934.586993:0:14229:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387934.587056:0:14229:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387934.587062:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+3:14261:x1874211709745664:12345-0@lo:104: Request processed in 84us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387934.587069:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787387934.587110:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387934.587117:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.587125:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e600 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:1.0:1787387934.587129:0:14234:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.587137:0:14234:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387934.587151:0:14234:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387934.587157:0:14234:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1787387934.587170:0:14261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14261:1874211709745664:0@lo:104: 00010000:00010000:1.0:1787387934.587184:0:14234:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387934.587187:0:14261:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.587191:0:14234:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387934.587209:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.587216:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d434152e600/0x93d41aeaa23c8731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8738 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387934.587235:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3313:1874211709745792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787387934.587243:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387934.587244:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387934.587246:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387934.587261:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387934.587454:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709745792 00000100:00100000:0.0:1787387934.587458:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709745792 00010000:00010000:0.0:1787387934.587475:0:14232:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d437460a000/0x93d41aeaa23c8738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c8731 expref: 17 pid: 14239 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387934.587533:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387934.587539:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:3313:x1874211709745792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387934.587559:0:14232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387934.587564:0:14232:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d437460a000/0x93d41aeaa23c8738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c8731 expref: 17 pid: 14239 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.587574:0:14232:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d437460a000/0x93d41aeaa23c8738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c8731 expref: 17 pid: 14239 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.587587:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d437460a000/0x93d41aeaa23c8738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c8731 expref: 17 pid: 14239 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.587598:0:14232:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.587606:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787387934.587617:0:14232:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002323608s 00010000:00010000:0.0:1787387934.587621:0:14232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.587628:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.587636:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.587646:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.587652:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc600 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387934.587656:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.587663:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.587676:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387934.587684:0:14232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387934.587711:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:3313:x1874211709745792:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387934.587717:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387934.587829:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3313:1874211709745792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787387934.588654:0:14261:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.588665:0:14261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387934.588672:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43413fc600/0x93d41aeaa23c87cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387934.595024:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14878:x1874211709745536:12345-0@lo:253:mount.lustre.0 Request processed in 44395us (44556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387934.595038:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787387934.595259:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14878:1874211709745536:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787387934.595274:0:14878:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787387934.595277:0:14878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787387934.595289:0:14878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387934.595290:0:14878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387934.595291:0:14878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387934.595293:0:14878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387934.595294:0:14878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387934.595296:0:14878:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387934.595297:0:14878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387934.595298:0:14878:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787387934.595313:0:14878:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787387934.599362:0:14878:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787387934.599573:0:14878:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787387934.599716:0:14878:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787387934.600192:0:14878:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787387934.600362:0:14878:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787387934.600584:0:14878:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787387934.601338:0:14878:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787387934.643911:0:14878:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787387934.643921:0:14878:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787387934.644078:0:14878:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787387934.644212:0:14878:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787387934.644239:0:14878:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787387934.644277:0:14878:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787387935.202364:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787387935.713024:0:14243:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787387935.713034:0:14243:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d437a1bb000 from 7 10000000:01000000:3.0:1787387935.713039:0:14243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787387935.713092:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387935.713104:0:14243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387935.713117:0:14243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387935.713160:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709745920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787387935.713240:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387935.713297:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342e72d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387935.713463:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709745920 00000100:00100000:1.0:1787387935.713472:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709745920 00000100:00100000:1.0:1787387935.713524:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787387935.713534:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+15:14243:x1874211709745920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387935.713547:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387935.713563:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152f000/0x93d41aeaa23c87d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c87d2 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387935.713586:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152f000/0x93d41aeaa23c87d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c87d2 expref: 16 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387935.713596:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152f000/0x93d41aeaa23c87d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c87d2 expref: 16 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387935.713605:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152f000, rc 0) 00000100:00100000:1.0:1787387935.713674:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14243:x1874211709745920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387935.713681:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787387935.717465:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709745920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387935.717498:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387935.717512:0:14243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387935.717592:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709746048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787387935.717670:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387935.717715:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4344ef5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387935.718828:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709746048 00000100:00100000:1.0:1787387935.718840:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709746048 00000100:00100000:1.0:1787387935.718899:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787387935.718909:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14243:x1874211709746048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787387935.718930:0:14238:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787387935.718948:0:14238:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787387935.718950:0:14238:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787387935.719046:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14243:x1874211709746048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387935.719054:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787387935.719152:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709746048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787387935.719223:0:14243:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787387935.719233:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387935.719244:0:14243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387936.224633:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387937.245888:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387938.269968:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387939.300160:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787387939.938947:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787387939.938954:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787387939.938957:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787387939.938961:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787387939.939005:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3314:1874211709746176:0@lo:400:kworker.0 00000100:00100000:3.0:1787387939.939070:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387939.939149:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709746304:0@lo:400:kworker.0 00000100:00100000:3.0:1787387939.939175:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387939.939193:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387939.939198:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709746432:0@lo:400:kworker.0 00000100:00100000:3.0:1787387939.939221:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387939.939246:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709746176 00000100:00100000:3.0:1787387939.939253:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709746176 00000100:00100000:3.0:1787387939.939296:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787387939.939304:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:3314:x1874211709746176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387939.939362:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:3314:x1874211709746176:12345-0@lo:400:kworker.0 Request processed in 58us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387939.939369:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787387939.939404:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709746304 00000100:00100000:3.0:1787387939.939407:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709746304 00000100:00100000:3.0:1787387939.939662:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709746432 00000100:00100000:3.0:1787387939.939667:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709746432 00000100:00100000:3.0:1787387939.939693:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387939.939699:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709746304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387939.939735:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709746304:12345-0@lo:400:kworker.0 Request processed in 36us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387939.939764:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387939.939777:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787387939.939783:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709746432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387939.939810:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709746432:12345-0@lo:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387939.939816:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787387939.939856:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d437a085500 x1874211709746432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387939.939871:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709746432:0@lo:400:kworker.0 00010000:00080000:3.0:1787387939.939883:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d437a086680 x1874211709746304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387939.939891:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709746304:0@lo:400:kworker.0 00000100:00100000:3.0:1787387939.939920:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3314:1874211709746176:0@lo:400:kworker.0 00000100:00080000:2.0:1787387939.942350:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787387940.319528:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787387940.537718:0:15246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787387941.346046:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387942.368961:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387943.390732:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387944.418503:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787387944.675148:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1787387945.056898:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787387945.056905:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787387945.056908:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787387945.056912:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787387945.056995:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3313:1874211709746560:0@lo:400:kworker.0 00000100:00100000:3.0:1787387945.057076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387945.057139:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387945.057145:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709746688:0@lo:400:kworker.0 00000100:00100000:3.0:1787387945.057183:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387945.057230:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709746816:0@lo:400:kworker.0 00000100:00100000:3.0:1787387945.057253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387945.057283:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709746688 00000100:00100000:3.0:1787387945.057290:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709746688 00000100:00100000:3.0:1787387945.057327:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709746816 00000100:00100000:3.0:1787387945.057330:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709746816 00000100:00100000:3.0:1787387945.057355:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387945.057362:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709746688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387945.057412:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709746688:12345-0@lo:400:kworker.0 Request processed in 49us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387945.057420:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387945.057437:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387945.057443:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709746816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387945.057646:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709746816:12345-0@lo:400:kworker.0 Request processed in 202us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387945.057652:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787387945.057676:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787387945.057770:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d437a821f80 x1874211709746816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387945.057784:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709746816:0@lo:400:kworker.0 00010000:00080000:3.0:1787387945.057812:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d437a821880 x1874211709746688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387945.057822:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709746688:0@lo:400:kworker.0 00000100:00100000:1.0:1787387945.058057:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709746560 00000100:00100000:1.0:1787387945.058062:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709746560 00000100:00100000:1.0:1787387945.058091:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787387945.058098:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:3313:x1874211709746560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387945.058135:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:3313:x1874211709746560:12345-0@lo:400:kworker.0 Request processed in 38us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387945.058141:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787387945.058590:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3313:1874211709746560:0@lo:400:kworker.0 00010000:00010000:0.0:1787387945.443048:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387946.462255:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787387947.165163:0:15547:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787387947.165177:0:15547:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787387947.165435:0:15547:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d43746ce000 00000020:01000004:2.0:1787387947.165450:0:15547:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787387947.165463:0:15547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787387947.165477:0:15547:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d43747d19c0) 00000020:00000080:2.0:1787387947.165494:0:15547:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787387947.203284:0:15547:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787387947.204295:0:15547:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787387947.205587:0:15547:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787387947.205986:0:15547:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787387947.206314:0:15547:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787387947.207264:0:15547:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 339: rc = 0 00100000:10000000:3.0:1787387947.207585:0:15547:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:3.0:1787387947.207687:0:15547:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:3.0:1787387947.208646:0:15547:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 603: rc = 0 00100000:10000000:3.0:1787387947.209239:0:15547:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 603: rc = 0 00100000:10000000:3.0:1787387947.209669:0:15547:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 603: rc = 0 00100000:10000000:3.0:1787387947.210560:0:15547:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 603: rc = 0 00100000:10000000:3.0:1787387947.210843:0:15547:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 603: rc = 0 00100000:10000000:3.0:1787387947.211556:0:15547:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 603: rc = 0 00000020:00000080:3.0:1787387947.212661:0:15547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787387947.212674:0:15547:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787387947.212686:0:15547:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x93d41aeaa23c87e7 00000020:01000004:3.0:1787387947.212695:0:15547:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787387947.212717:0:15547:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787387947.212721:0:15547:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787387947.212727:0:15547:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787387947.212777:0:15547:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787387947.212782:0:15547:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787387947.227309:0:15547:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787387947.227513:0:15547:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.159@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787387947.227518:0:15547:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787387947.227520:0:15547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387947.227521:0:15547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387947.227522:0:15547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387947.227523:0:15547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387947.227525:0:15547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387947.227526:0:15547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387947.227528:0:15547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387947.227529:0:15547:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787387947.227534:0:15547:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787387947.227536:0:15547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787387947.227537:0:15547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387947.227538:0:15547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387947.227539:0:15547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387947.227540:0:15547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387947.227541:0:15547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387947.227542:0:15547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387947.227543:0:15547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387947.227544:0:15547:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787387947.227572:0:15547:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787387947.227593:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709746944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787387947.227658:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387947.227779:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787387947.227997:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709746944 00000100:00100000:3.0:1787387947.228004:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709746944 00000100:00100000:2.0:1787387947.228325:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787387947.228335:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:15547:x1874211709746944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787387947.228383:0:14238:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787387947.228387:0:14238:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787387947.228396:0:14238:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787387947.234833:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:15547:x1874211709746944:12345-0@lo:253:mount.lustre.0 Request processed in 6490us (7165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.234849:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787387947.235036:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709746944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787387947.235053:0:15547:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787387947.235056:0:15547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787387947.235058:0:15547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387947.235059:0:15547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387947.235061:0:15547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387947.235062:0:15547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387947.235063:0:15547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387947.235131:0:15547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387947.235134:0:15547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387947.235135:0:15547:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787387947.235155:0:15547:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d43746ce000 from lustre-OST0001 10000000:01000000:2.0:1787387947.235255:0:15547:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787387947.235258:0:15547:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787387947.235266:0:15547:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d4345184d40 local copy 00010000:00010000:2.0:1787387947.235277:0:15547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c865f expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387947.235662:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787387947.235706:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387947.235836:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1540 going to sleep for 11 seconds 00000100:00100000:3.0:1787387947.236245:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709747072 00000100:00100000:3.0:1787387947.236253:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709747072 00000100:00100000:3.0:1787387947.236356:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787387947.236366:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:15547:x1874211709747072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787387947.236779:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:15547:x1874211709747072:12345-0@lo:501:mount.lustre.0 Request processed in 415us (1072us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787387947.236788:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787387947.236874:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747072:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787387947.236905:0:15547:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787387947.237089:0:15547:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787387947.237098:0:15547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c865f expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387947.237108:0:15547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d437460b200/0x93d41aeaa23c8658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c865f expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387947.237147:0:15547:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d43746ce000 10000000:01000000:2.0:1787387947.237152:0:15547:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787387947.237168:0:15547:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787387947.237171:0:15547:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787387947.237175:0:15547:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787387947.237177:0:15547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787387947.237203:0:15547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c87ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387947.237211:0:15547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c87ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387947.237220:0:15547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c87ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387947.237236:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787387947.237268:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387947.237754:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1540 going to sleep for 11 seconds 00000100:00100000:1.0:1787387947.238013:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709747200 00000100:00100000:1.0:1787387947.238020:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709747200 00000100:00100000:1.0:1787387947.238078:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787387947.238088:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:15547:x1874211709747200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787387947.238098:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387947.238112:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c87f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c87ee expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387947.238137:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c87f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c87ee expref: 17 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387947.238148:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152e400/0x93d41aeaa23c87f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c87ee expref: 17 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387947.238169:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152e400, rc 0) 00000100:00100000:1.0:1787387947.238224:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:15547:x1874211709747200:12345-0@lo:101:mount.lustre.0 Request processed in 138us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.238232:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787387947.238323:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787387947.238350:0:15547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c87ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87f5 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387947.238361:0:15547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c87ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c87f5 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787387947.239078:0:15547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787387947.239953:0:15547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387947.240195:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787387947.240253:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787387947.240289:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787387947.240341:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787387947.240378:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787387947.240415:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787387947.240485:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787387947.240494:0:15547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787387947.240567:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787387947.240627:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387947.240666:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387947.241081:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709747328 00000100:00100000:1.0:1787387947.241089:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709747328 00000100:00100000:1.0:1787387947.241128:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787387947.241137:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:15547:x1874211709747328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787387947.241525:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:15547:x1874211709747328:12345-0@lo:501:mount.lustre.0 Request processed in 388us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.241533:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787387947.242318:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787387947.242522:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787387947.242580:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387947.242609:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387947.242684:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709747456 00000100:00100000:3.0:1787387947.242690:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709747456 00000100:00100000:2.0:1787387947.242900:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787387947.242909:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:15547:x1874211709747456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787387947.243285:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:15547:x1874211709747456:12345-0@lo:503:mount.lustre.0 Request processed in 377us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387947.243293:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787387947.243571:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787387947.244583:0:15547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787387947.244666:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787387947.244726:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387947.244799:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435896d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387947.245148:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709747584 00000100:00100000:1.0:1787387947.245166:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709747584 00000100:00100000:1.0:1787387947.245203:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787387947.245213:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:15547:x1874211709747584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787387947.245697:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:15547:x1874211709747584:12345-0@lo:502:mount.lustre.0 Request processed in 484us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.245706:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787387947.246331:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787387947.246846:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787387947.246922:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787387947.246959:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787387947.247022:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787387947.247063:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787387947.247116:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787387947.247519:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787387947.247564:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787387947.247612:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787387947.247652:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787387947.247717:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387947.247779:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435896d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387947.247981:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709747712 00000100:00100000:1.0:1787387947.247989:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709747712 00000100:00100000:1.0:1787387947.248040:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787387947.248050:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:15547:x1874211709747712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787387947.248553:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:15547:x1874211709747712:12345-0@lo:502:mount.lustre.0 Request processed in 503us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.248561:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787387947.248706:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787387947.248833:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787387947.248846:0:15547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787387947.252224:0:15548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787387947.252236:0:15548:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787387947.252244:0:15548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387947.252246:0:15548:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787387947.252253:0:15548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787387947.252268:0:15548:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d4242c9cd40) 00000020:00000080:0.0:1787387947.252291:0:15548:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787387947.252299:0:15548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787387947.252524:0:15548:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d43746ce000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787387947.252532:0:15548:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787387947.252540:0:15548:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x93d41aeaa23c8803 00010000:00010000:0.0:1787387947.258518:0:15548:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787387947.259552:0:15548:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1787387947.262713:0:15548:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787387947.269812:0:15548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787387947.269825:0:15548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387947.269832:0:15548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387947.269834:0:15548:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787387947.269837:0:15548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387947.269841:0:15548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387947.269842:0:15548:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787387947.269846:0:15548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787387947.269848:0:15548:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787387947.269850:0:15548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387947.269852:0:15548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387947.269853:0:15548:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787387947.269855:0:15548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387947.269858:0:15548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387947.269859:0:15548:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787387947.269862:0:15548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787387947.269940:0:15548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387947.269944:0:15548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387947.269946:0:15548:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787387947.269962:0:15548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787387947.271487:0:15547:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787387947.271527:0:15547:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787387947.271554:0:15547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c87ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87f5 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387947.271567:0:15547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d43413fde00/0x93d41aeaa23c87ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c87f5 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387947.271576:0:15547:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d43746ce000 from 1 10000000:01000000:2.0:1787387947.271586:0:15547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387947.271626:0:15547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387947.271634:0:15547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387947.271645:0:15547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387947.271668:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787387947.271735:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387947.271785:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387947.272190:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709747840 00000100:00100000:1.0:1787387947.272199:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709747840 00000100:00100000:1.0:1787387947.272255:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787387947.272266:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:15547:x1874211709747840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787387947.272280:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387947.272293:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c8811 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c880a expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387947.272320:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c8811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c880a expref: 18 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387947.272331:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c8811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c880a expref: 18 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387947.272533:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d434152ec00, rc 0) 00000100:00100000:1.0:1787387947.272583:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:15547:x1874211709747840:12345-0@lo:101:mount.lustre.0 Request processed in 319us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.272589:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787387947.273022:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787387947.273040:0:15547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387947.273049:0:15547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787387947.273850:0:15547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787387947.276228:0:15547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387947.276887:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787387947.276939:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787387947.277019:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787387947.277028:0:15547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787387947.277427:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787387947.277564:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387947.277606:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387947.277691:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709747968 00000100:00100000:0.0:1787387947.277699:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709747968 00000100:00100000:0.0:1787387947.277779:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787387947.277789:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:15547:x1874211709747968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787387947.278037:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:15547:x1874211709747968:12345-0@lo:501:mount.lustre.0 Request processed in 249us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387947.278054:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787387947.278367:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709747968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787387947.278414:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787387947.278588:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387947.278618:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d435896d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787387947.278708:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709748096 00000100:00100000:2.0:1787387947.278721:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709748096 00000100:00100000:2.0:1787387947.278772:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787387947.278780:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:15547:x1874211709748096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787387947.279548:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:15547:x1874211709748096:12345-0@lo:503:mount.lustre.0 Request processed in 766us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387947.279557:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787387947.283580:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748096:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787387947.285630:0:15547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787387947.285734:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787387947.285838:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387947.285891:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1540 going to sleep for 11 seconds 00000100:00100000:3.0:1787387947.286661:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709748224 00000100:00100000:3.0:1787387947.286669:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709748224 00000100:00100000:3.0:1787387947.286722:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787387947.286732:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:15547:x1874211709748224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787387947.287030:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:15547:x1874211709748224:12345-0@lo:502:mount.lustre.0 Request processed in 298us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387947.287038:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787387947.287351:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787387947.287792:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787387947.287849:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787387947.287989:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787387947.288031:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787387947.288270:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787387947.288331:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787387947.288536:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787387947.288576:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787387947.288618:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787387947.288680:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387947.288723:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464d1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387947.289040:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709748352 00000100:00100000:0.0:1787387947.289048:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709748352 00000100:00100000:0.0:1787387947.289107:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787387947.289116:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:15547:x1874211709748352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787387947.289635:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:15547:x1874211709748352:12345-0@lo:502:mount.lustre.0 Request processed in 518us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387947.289645:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787387947.289772:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787387947.289900:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787387947.289914:0:15547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787387947.292008:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387947.292022:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387947.292024:0:15552:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787387947.292032:0:15552:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d43746ce000 00000020:00000080:0.0:1787387947.292034:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787387947.292041:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387947.292044:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387947.292046:0:15552:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787387947.292048:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387947.292050:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387947.292051:0:15552:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787387947.292054:0:15552:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d43746ce000 00000020:00000080:0.0:1787387947.292056:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787387947.292268:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387947.292272:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387947.292273:0:15552:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787387947.292276:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387947.292278:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387947.292280:0:15552:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787387947.292283:0:15552:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d43746ce000 00000020:00000080:0.0:1787387947.292285:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787387947.292328:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387947.292982:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387947.292985:0:15552:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787387947.292989:0:15552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787387947.293061:0:15547:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787387947.293526:0:15547:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387947.293552:0:15547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.293564:0:15547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387947.293607:0:15547:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787387947.293610:0:15547:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d43746ce000 10000000:01000000:0.0:1787387947.293613:0:15547:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d43746ce000 10000000:01000000:0.0:1787387947.293616:0:15547:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787387947.293622:0:15547:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d43746ce000 from 1 10000000:01000000:0.0:1787387947.293624:0:15547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787387947.293657:0:15547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4377c70600/0x93d41aeaa23c8818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.293665:0:15547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4377c70600/0x93d41aeaa23c8818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.293675:0:15547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4377c70600/0x93d41aeaa23c8818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387947.293700:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787387947.293810:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387947.293847:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709748480 00000100:00100000:0.0:1787387947.293854:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709748480 00000100:00100000:0.0:1787387947.296415:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787387947.296966:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:15547:x1874211709748480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787387947.296995:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387947.297014:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4377c71800/0x93d41aeaa23c881f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c8818 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.297046:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4377c71800/0x93d41aeaa23c881f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c8818 expref: 19 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.297058:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4377c71800/0x93d41aeaa23c881f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8818 expref: 19 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.297517:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71800, rc 0) 00000100:00100000:0.0:1787387947.297591:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:15547:x1874211709748480:12345-0@lo:101:mount.lustre.0 Request processed in 632us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387947.297599:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787387947.297679:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387947.297705:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787387947.297722:0:15547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4377c70600/0x93d41aeaa23c8818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c881f expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.297732:0:15547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4377c70600/0x93d41aeaa23c8818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c881f expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787387947.300084:0:15547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787387947.300485:0:15547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387947.302486:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787387947.302572:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787387947.302611:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787387947.302666:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787387947.302717:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787387947.302783:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787387947.305031:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787387947.305150:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787387947.305235:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787387947.305275:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787387947.305312:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787387947.305604:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787387947.305642:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787387947.305672:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787387947.305716:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787387947.305774:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787387947.305818:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787387947.305860:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787387947.305980:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787387947.306021:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787387947.306139:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787387947.306252:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787387947.306289:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787387947.306425:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787387947.307029:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787387947.307136:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787387947.307281:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787387947.307320:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787387947.307610:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787387947.307665:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787387947.307701:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787387947.307731:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787387947.308016:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787387947.308416:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787387947.308551:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787387947.308602:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787387947.308639:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787387947.308786:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787387947.308797:0:15547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787387947.309288:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787387947.309511:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387947.309593:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387947.309637:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709748608 00000100:00100000:1.0:1787387947.309645:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709748608 00000100:00100000:1.0:1787387947.309725:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787387947.309735:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:15547:x1874211709748608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787387947.310360:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:15547:x1874211709748608:12345-0@lo:501:mount.lustre.0 Request processed in 624us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.310370:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787387947.310580:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787387947.310622:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787387947.310664:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387947.310695:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387947.310766:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709748736 00000100:00100000:1.0:1787387947.310772:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709748736 00000100:00100000:1.0:1787387947.310804:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787387947.310819:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:15547:x1874211709748736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787387947.311417:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:15547:x1874211709748736:12345-0@lo:503:mount.lustre.0 Request processed in 598us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.311424:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787387947.311536:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748736:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787387947.312103:0:15547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787387947.312190:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787387947.312237:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387947.312270:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387947.312587:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709748864 00000100:00100000:1.0:1787387947.312593:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709748864 00000100:00100000:1.0:1787387947.312634:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787387947.312641:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:15547:x1874211709748864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787387947.312937:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:15547:x1874211709748864:12345-0@lo:502:mount.lustre.0 Request processed in 295us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.312945:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787387947.313316:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787387947.313642:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787387947.313707:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787387947.313824:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787387947.314046:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787387947.314265:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787387947.314981:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787387947.315050:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787387947.315289:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787387947.316028:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787387947.316335:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787387947.316526:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787387947.316576:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787387947.316619:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787387947.316647:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787387947.316714:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787387947.316814:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787387947.316866:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787387947.316937:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787387947.316988:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787387947.317045:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787387947.318626:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787387947.318690:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787387947.318727:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787387947.318817:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787387947.318857:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787387947.318894:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787387947.318940:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787387947.318986:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787387947.319023:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787387947.319071:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787387947.319106:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787387947.319140:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787387947.319647:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787387947.319705:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787387947.319773:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787387947.319846:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787387947.319879:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787387947.319910:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787387947.319955:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787387947.320003:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787387947.320053:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787387947.320139:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387947.321001:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709748992 00000100:00100000:2.0:1787387947.321011:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709748992 00000100:00100000:2.0:1787387947.321072:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787387947.321083:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:15547:x1874211709748992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787387947.321532:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:15547:x1874211709748992:12345-0@lo:502:mount.lustre.0 Request processed in 256us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387947.321548:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787387947.321718:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4373bb8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387947.321762:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709748992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787387947.322964:0:15547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787387947.323000:0:15547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787387947.329021:0:15556:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787387947.329038:0:15556:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d4381440000) 00000020:00000080:1.0:1787387947.329060:0:15556:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787387947.329217:0:15556:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d43746ce000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787387947.329221:0:15556:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d43746ce000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787387947.329224:0:15556:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d43746ce000 3 00010000:00080000:1.0:1787387947.329257:0:15556:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4377cbc800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1787387947.335036:0:15556:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787387947.335289:0:15556:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787387947.336006:0:15556:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787387947.336026:0:15556:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x93d41aeaa23c882d 00000100:00080000:1.0:1787387947.336039:0:15556:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787387947.336047:0:15556:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d4377cbc800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1787387947.336556:0:15556:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437a823100 x1874211709749120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787387947.336599:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874211709749120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787387947.337298:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387947.338014:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709749120 00000100:00100000:1.0:1787387947.338024:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709749120 00000100:00100000:1.0:1787387947.338139:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387947.338150:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1874211709749120:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787387947.338251:0:14246:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:1.0:1787387947.338293:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x93d41aeaa23c8834 00000004:00100000:1.0:1787387947.338311:0:14246:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787387947.338989:0:14246:0:(import.c:65:import_set_state_nolock()) ffff8d437aab8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387947.339415:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874211709749120:12345-0@lo:38:llog_process_th.0 Request processed in 914us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.339426:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787387947.339628:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d437a823100 x1874211709749120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387947.339641:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787387947.339649:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787387947.339659:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787387947.339664:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787387947.339667:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4377cbc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787387947.339673:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874211709749120:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787387947.339696:0:15556:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787387947.339722:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787387947.339727:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787387947.339729:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787387947.339761:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787387947.339826:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709749248:0@lo:400:kworker.0 00000100:00100000:1.0:1787387947.339866:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387947.341040:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709749376:0@lo:400:kworker.0 00000100:00100000:1.0:1787387947.341567:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387947.341621:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709749248 00000100:00100000:1.0:1787387947.341629:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709749248 00000100:00100000:1.0:1787387947.341668:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709749376 00000100:00100000:1.0:1787387947.341671:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709749376 00000100:00100000:1.0:1787387947.341699:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787387947.341707:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709749248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387947.341776:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709749248:12345-0@lo:400:kworker.0 Request processed in 69us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.341783:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787387947.341798:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387947.341804:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709749376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387947.341834:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709749376:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.341840:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787387947.341860:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787387947.343069:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d437a823100 x1874211709749248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387947.343085:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709749248:0@lo:400:kworker.0 00010000:00080000:0.0:1787387947.345267:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d437a821f80 x1874211709749376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387947.345286:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709749376:0@lo:400:kworker.0 00000040:00080000:2.0:1787387947.347287:0:15556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787387947.347518:0:15547:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787387947.347550:0:15547:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787387947.347578:0:15547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4377c70600/0x93d41aeaa23c8818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c881f expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.347591:0:15547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4377c70600/0x93d41aeaa23c8818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c881f expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787387947.347648:0:15547:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787387947.347650:0:15547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787387947.347652:0:15547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387947.347653:0:15547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787387947.347655:0:15547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387947.347656:0:15547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387947.347658:0:15547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787387947.347660:0:15547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387947.347662:0:15547:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787387947.347666:0:15547:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787387947.347668:0:15547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787387947.347669:0:15547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787387947.347671:0:15547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787387947.347672:0:15547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787387947.347673:0:15547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787387947.347674:0:15547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787387947.347675:0:15547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787387947.347676:0:15547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787387947.347677:0:15547:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787387947.347706:0:15547:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787387947.347782:0:15547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709749504:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787387947.347868:0:15547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387947.348514:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709749504 00000100:00100000:1.0:1787387947.348523:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709749504 00000100:00100000:1.0:1787387947.348577:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787387947.348586:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:15547:x1874211709749504:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787387947.348613:0:14239:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787387947.348626:0:14239:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787387947.348978:0:15547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4377f64cc0 going to sleep for 11 seconds 20000000:01000000:0.0:1787387947.396825:0:14239:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787387947.396839:0:14239:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787387947.397961:0:14261:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787387947.397979:0:14261:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787387947.398001:0:14261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387947.398022:0:14261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d434152f000/0x93d41aeaa23c87d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c87d2 expref: 19 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387947.398031:0:14261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387947.398151:0:14261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d434152f000/0x93d41aeaa23c87d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c87d2 expref: 19 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387947.398242:0:14261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d434152f000/0x93d41aeaa23c87d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c87d2 expref: 19 pid: 14239 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387947.398258:0:14261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a821500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14261:1874211709749632:0@lo:104: 00000100:00100000:1.0:1787387947.398324:0:14261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387947.398537:0:14261:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d434644e240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387947.399814:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709749632 00000100:00100000:3.0:1787387947.399826:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709749632 00000100:00100000:3.0:1787387947.399888:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787387947.399899:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+3:14261:x1874211709749632:12345-0@lo:104: 00010000:00010000:3.0:1787387947.399915:0:14229:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387947.400000:0:14229:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387947.400007:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+3:14261:x1874211709749632:12345-0@lo:104: Request processed in 111us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387947.400013:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787387947.400060:0:14261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a821500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14261:1874211709749632:0@lo:104: 00010000:00010000:3.0:1787387947.400104:0:14261:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400356:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387947.400364:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400371:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a200 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:0.0:1787387947.400375:0:14233:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400384:0:14233:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387947.400391:0:14233:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387947.400397:0:14233:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387947.400443:0:14233:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400450:0:14233:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387947.400471:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400479:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d437460a200/0x93d41aeaa23c87d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c87d9 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400495:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387947.400505:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387947.400507:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387947.400520:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3314:1874211709749760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387947.400561:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387947.400610:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709749760 00000100:00100000:0.0:1787387947.400615:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709749760 00010000:00010000:0.0:1787387947.400632:0:14230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d434152f000/0x93d41aeaa23c87d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c87d2 expref: 20 pid: 14239 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387947.400654:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387947.400660:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+20:3314:x1874211709749760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387947.400670:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387947.400675:0:14230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d434152f000/0x93d41aeaa23c87d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c87d2 expref: 20 pid: 14239 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400685:0:14230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d434152f000/0x93d41aeaa23c87d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c87d2 expref: 20 pid: 14239 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400699:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152f000/0x93d41aeaa23c87d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c87d2 expref: 20 pid: 14239 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400713:0:14230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400721:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787387947.400734:0:14230:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002766200s 00010000:00010000:0.0:1787387947.400758:0:14230:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400777:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400784:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400791:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400796:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f200 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387947.400801:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400808:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400822:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400831:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387947.400858:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3314:x1874211709749760:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387947.400879:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387947.400911:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3314:1874211709749760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387947.400946:0:14261:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400954:0:14261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387947.400982:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152f200/0x93d41aeaa23c883b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387947.411061:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:15547:x1874211709749504:12345-0@lo:253:mount.lustre.0 Request processed in 62467us (63184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387947.411088:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787387947.411583:0:15547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:15547:1874211709749504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787387947.411599:0:15547:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787387947.411603:0:15547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787387947.411605:0:15547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787387947.411606:0:15547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387947.411608:0:15547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387947.411609:0:15547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387947.411611:0:15547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387947.411612:0:15547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387947.411614:0:15547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387947.411615:0:15547:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787387947.411629:0:15547:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787387947.419273:0:15547:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787387947.419622:0:15547:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787387947.419827:0:15547:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787387947.420258:0:15547:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787387947.420596:0:15547:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787387947.420982:0:15547:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787387947.422962:0:15547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787387947.485348:0:15547:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787387947.485358:0:15547:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787387947.485390:0:15547:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787387947.485449:0:15547:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787387947.485464:0:15547:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787387947.485557:0:15547:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787387947.500922:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387948.404501:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787387932/real 1787387932] req@ffff8d437ab46300 x1874211709742720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787387947 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387948.404533:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d437ab46300 x1874211709742720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787387947 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387948.404545:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787387932/real 1787387932] req@ffff8d437ab45c00 x1874211709742848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787387947 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387948.404557:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d437ab45c00 x1874211709742848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787387947 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787387948.404577:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4377cb8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787387948.404597:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787387948.404601:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709742720:0@lo:8:kworker.0 00000100:00080000:3.0:1787387948.404606:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d437428e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787387948.404612:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787387948.404615:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709742848:0@lo:8:kworker.0 00000100:00080000:3.0:1787387948.404679:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787387948.404683:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787387948.404685:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d4377cb8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787387948.404690:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1787387948.404695:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787387948.404701:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d4377cb8800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1787387948.404720:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437a085f80 x1874211709750016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787387948.404767:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787387948.404771:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787387948.404773:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d437428e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787387948.404776:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1787387948.404779:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787387948.404783:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d437428e000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1787387948.404795:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d437a087b80 x1874211709750144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787387948.404850:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709749888:0@lo:400:kworker.0 00000100:00100000:3.0:1787387948.404910:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387948.404962:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387948.404969:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709750272:0@lo:400:kworker.0 00000100:00100000:3.0:1787387948.404993:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387948.405020:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709750400:0@lo:400:kworker.0 00000100:00100000:3.0:1787387948.405039:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387948.405053:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387948.405057:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709750528:0@lo:400:kworker.0 00000100:00100000:3.0:1787387948.405076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387948.405100:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709749888 00000100:00100000:3.0:1787387948.405106:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709749888 00000100:00100000:3.0:1787387948.405143:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787387948.405150:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:3311:x1874211709749888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387948.405189:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:3311:x1874211709749888:12345-0@lo:400:kworker.0 Request processed in 39us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387948.405204:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787387948.405832:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709750272 00000100:00100000:2.0:1787387948.405838:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709750272 00000100:00100000:2.0:1787387948.405861:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709750400 00000100:00100000:2.0:1787387948.405864:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709750400 00000100:00100000:2.0:1787387948.405874:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709750528 00000100:00100000:2.0:1787387948.405876:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709750528 00000100:00100000:2.0:1787387948.405906:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387948.405912:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709750272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387948.405967:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874211709750272:12345-0@lo:400:kworker.0 Request processed in 56us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.405973:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387948.405985:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387948.405991:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709750400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387948.406022:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709750400:12345-0@lo:400:kworker.0 Request processed in 31us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.406027:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387948.406037:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387948.406042:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709750528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387948.406065:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709750528:12345-0@lo:400:kworker.0 Request processed in 23us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.406080:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387948.406102:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709750016:0@lo:8:kworker.0 00000100:00100000:2.0:1787387948.406133:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387948.406149:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709750144:0@lo:8:kworker.0 00000100:00100000:2.0:1787387948.406167:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787387948.406238:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387948.406255:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709750016 00000100:00100000:0.0:1787387948.406258:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709750016 00000100:00100000:0.0:1787387948.406279:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709750144 00000100:00100000:0.0:1787387948.406282:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709750144 00000100:00100000:0.0:1787387948.406291:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387948.406296:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874211709750016:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787387948.406317:0:14879:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1787387948.406348:0:14879:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x93d41aeaa23c8842 00002000:00100000:0.0:1787387948.406361:0:14879:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d4381c65000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787387948.406371:0:14879:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787387948.406374:0:14879:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787387948.406814:0:14879:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787387948.406839:0:14879:0:(import.c:65:import_set_state_nolock()) ffff8d4381c62800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387948.406887:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874211709750016:12345-0@lo:8:kworker.0 Request processed in 589us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.406894:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387948.406909:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387948.406913:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874211709750144:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787387948.406929:0:14879:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1787387948.406944:0:14879:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x93d41aeaa23c8849 00002000:00100000:0.0:1787387948.406959:0:14879:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d4381c65800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787387948.406964:0:14879:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787387948.406966:0:14879:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787387948.407156:0:14879:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787387948.407169:0:14879:0:(import.c:65:import_set_state_nolock()) ffff8d4381c62000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387948.407198:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874211709750144:12345-0@lo:8:kworker.0 Request processed in 283us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.407203:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787387948.407731:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a085f80 x1874211709750016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387948.407761:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787387948.407769:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787387948.407776:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787387948.407782:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787387948.407785:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d4377cb8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787387948.407799:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787387948.407804:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709750016:0@lo:8:kworker.0 00010000:00080000:1.0:1787387948.407822:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a087b80 x1874211709750144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387948.407829:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787387948.407832:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787387948.407837:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787387948.407839:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787387948.407841:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d437428e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787387948.407851:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787387948.407855:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874211709750144:0@lo:8:kworker.0 00000004:00080000:1.0:1787387948.407909:0:14268:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787387948.407929:0:14268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a822a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14268:1874211709750784:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787387948.407973:0:14268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387948.407990:0:14268:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351228180 going to sleep for 11 seconds 00000004:00080000:1.0:1787387948.408005:0:14267:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787387948.408392:0:14267:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 452857651460ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787387948.408556:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709750656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387948.408592:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787387948.408623:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a087100 x1874211709750272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387948.408634:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874211709750272:0@lo:400:kworker.0 00000100:00100000:3.0:1787387948.408646:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709749888:0@lo:400:kworker.0 00010000:00080000:3.0:1787387948.408679:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a086300 x1874211709750528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387948.408688:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709750528:0@lo:400:kworker.0 00010000:00080000:3.0:1787387948.408699:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a084e00 x1874211709750400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387948.408707:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709750400:0@lo:400:kworker.0 00000100:00100000:3.0:1787387948.408733:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709750784 00000100:00100000:3.0:1787387948.408754:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709750784 00000100:00100000:3.0:1787387948.408795:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387948.408803:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14268:x1874211709750784:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787387948.409708:0:14269:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787387948.410020:0:14269:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 452859280172ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787387948.410055:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709750656 00000100:00100000:2.0:1787387948.410062:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709750656 00000100:00100000:2.0:1787387948.410098:0:14883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387948.410107:0:14883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874211709750656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387948.410132:0:14883:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387948.410200:0:14883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874211709750656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.410207:0:14883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:1.0:1787387948.412373:0:14270:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787387948.413307:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a823b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14270:1874211709751040:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787387948.413370:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387948.413575:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351228840 going to sleep for 11 seconds 00000100:00100000:1.0:1787387948.413598:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709750912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387948.413623:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387948.413665:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709750912 00000100:00100000:1.0:1787387948.413670:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709750912 00000100:00100000:1.0:1787387948.413710:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387948.413718:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709750912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387948.413753:0:14884:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387948.413798:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709750912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387948.413805:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387948.415100:0:14879:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787387948.415111:0:14879:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:1.0:1787387948.415166:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a823800 x1874211709750912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387948.415188:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709750912:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787387948.417820:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437a820a80 x1874211709750656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387948.417847:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709750656:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787387948.417883:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787387948.417889:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1787387948.422530:0:14880:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787387948.422543:0:14880:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787387948.422549:0:14880:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:1.0:1787387948.423383:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709751040 00000100:00100000:1.0:1787387948.423395:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709751040 00000100:00100000:2.0:1787387948.425561:0:15604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387948.425578:0:15604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14270:x1874211709751040:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787387948.430822:0:15604:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787387948.430836:0:15604:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787387948.430841:0:15604:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1787387948.440140:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.440150:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8850 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.440180:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.440184:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.440191:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.440209:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.440237:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.440245:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.440270:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787387948.440533:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387948.440541:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.440548:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387948.440552:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.440574:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.440594:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8850 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.440601:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8850 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.440617:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.440619:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.440621:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.441110:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.441117:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f5aedc9/0x93d41aeaa23c8857 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.441126:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.441129:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.441133:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f5aedc9/0x93d41aeaa23c8857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.441142:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f5aedc9/0x93d41aeaa23c8857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.441159:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f5aedc9/0x93d41aeaa23c8857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.441167:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f5aedc9/0x93d41aeaa23c8857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.441188:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787387948.441365:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387948.441371:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f5aedc9/0x93d41aeaa23c8857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.441379:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ac00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387948.441383:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f5aedc9/0x93d41aeaa23c8857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.441390:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f5aedc9/0x93d41aeaa23c8857 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.441414:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f5aedc9/0x93d41aeaa23c8857 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.441432:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f5aedc9/0x93d41aeaa23c8857 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.441447:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.441449:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.441450:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.442481:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.442490:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014733c57/0x93d41aeaa23c885e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.442502:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.442506:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.442511:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014733c57/0x93d41aeaa23c885e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.442520:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014733c57/0x93d41aeaa23c885e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.442528:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014733c57/0x93d41aeaa23c885e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.442535:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014733c57/0x93d41aeaa23c885e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.442613:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787387948.443051:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.443058:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8865 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.443067:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.443070:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.443074:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.443083:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.443091:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.443097:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.449985:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387948.449998:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014733c57/0x93d41aeaa23c885e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.450012:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460aa00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387948.450018:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014733c57/0x93d41aeaa23c885e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.450029:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014733c57/0x93d41aeaa23c885e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.450053:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014733c57/0x93d41aeaa23c885e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.450061:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014733c57/0x93d41aeaa23c885e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.450084:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387948.450089:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.450108:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b800 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387948.450111:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.450119:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8865 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.450129:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8865 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.450137:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.450138:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.450140:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.458839:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787387948.458856:0:14880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015883f7a/0x93d41aeaa23c8865 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787387948.461006:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.461017:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e204f7/0x93d41aeaa23c886c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.461038:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.461042:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.461048:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097e204f7/0x93d41aeaa23c886c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.461062:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097e204f7/0x93d41aeaa23c886c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.461072:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e204f7/0x93d41aeaa23c886c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.461078:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097e204f7/0x93d41aeaa23c886c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.461101:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787387948.462435:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387948.462448:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097e204f7/0x93d41aeaa23c886c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.462460:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a600 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387948.462466:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e204f7/0x93d41aeaa23c886c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.462492:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e204f7/0x93d41aeaa23c886c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.462512:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097e204f7/0x93d41aeaa23c886c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.462519:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097e204f7/0x93d41aeaa23c886c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.462542:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.462543:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.462545:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.462571:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.466417:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.466431:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c8873 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.466446:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.466450:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.466456:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c8873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.466469:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c8873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.466489:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c8873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.466496:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c8873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.466520:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787387948.466536:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387948.466541:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c8873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.466549:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ba00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387948.466553:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c8873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.466561:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c8873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.466576:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c8873 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.466583:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c8873 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.466601:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.466608:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.466610:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.467120:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.467127:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6d7c281/0x93d41aeaa23c887a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.467135:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.467139:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.467144:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6d7c281/0x93d41aeaa23c887a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.467153:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6d7c281/0x93d41aeaa23c887a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.467161:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6d7c281/0x93d41aeaa23c887a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.467168:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6d7c281/0x93d41aeaa23c887a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.467184:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787387948.467193:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387948.467197:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6d7c281/0x93d41aeaa23c887a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.467204:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a800 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387948.467207:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6d7c281/0x93d41aeaa23c887a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.467225:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6d7c281/0x93d41aeaa23c887a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.467237:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6d7c281/0x93d41aeaa23c887a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.467244:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6d7c281/0x93d41aeaa23c887a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.467258:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.467259:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.467261:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.474702:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.474717:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8881 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.474751:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.474757:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.474764:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.474777:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.474788:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.474810:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.474839:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787387948.475468:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.475476:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f76340/0x93d41aeaa23c8888 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475487:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.475490:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.475496:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f76340/0x93d41aeaa23c8888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475505:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8f76340/0x93d41aeaa23c8888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475513:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f76340/0x93d41aeaa23c8888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475520:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f76340/0x93d41aeaa23c8888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475542:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787387948.475557:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787387948.475562:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475575:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387948.475580:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475589:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8881 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475606:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8881 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475614:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8881 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475634:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387948.475638:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8f76340/0x93d41aeaa23c8888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475645:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460be00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387948.475648:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f76340/0x93d41aeaa23c8888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475656:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f76340/0x93d41aeaa23c8888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475664:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8f76340/0x93d41aeaa23c8888 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475676:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8f76340/0x93d41aeaa23c8888 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.475690:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.475692:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.475694:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.476141:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.476148:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe1081db/0x93d41aeaa23c888f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476158:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.476162:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.476166:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1081db/0x93d41aeaa23c888f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476176:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe1081db/0x93d41aeaa23c888f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476185:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe1081db/0x93d41aeaa23c888f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476192:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1081db/0x93d41aeaa23c888f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476209:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787387948.476219:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387948.476227:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe1081db/0x93d41aeaa23c888f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476235:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a200 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387948.476238:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe1081db/0x93d41aeaa23c888f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476246:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe1081db/0x93d41aeaa23c888f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476258:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe1081db/0x93d41aeaa23c888f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476266:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe1081db/0x93d41aeaa23c888f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476279:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.476281:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.476283:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.476671:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.476677:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000024e6967/0x93d41aeaa23c8896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476686:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.476689:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.476693:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000024e6967/0x93d41aeaa23c8896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476712:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000024e6967/0x93d41aeaa23c8896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476719:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000024e6967/0x93d41aeaa23c8896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476725:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000024e6967/0x93d41aeaa23c8896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476778:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787387948.476788:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387948.476791:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000024e6967/0x93d41aeaa23c8896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476797:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387948.476801:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000024e6967/0x93d41aeaa23c8896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476808:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000024e6967/0x93d41aeaa23c8896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476818:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000024e6967/0x93d41aeaa23c8896 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476824:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000024e6967/0x93d41aeaa23c8896 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.476842:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.476843:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.476845:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.477220:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.477226:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000750ff964/0x93d41aeaa23c889d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.477234:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.477237:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.477242:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000750ff964/0x93d41aeaa23c889d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.477250:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000750ff964/0x93d41aeaa23c889d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.477257:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000750ff964/0x93d41aeaa23c889d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.477263:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000750ff964/0x93d41aeaa23c889d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.477276:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787387948.477283:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387948.477287:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000750ff964/0x93d41aeaa23c889d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.477302:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387948.477305:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000750ff964/0x93d41aeaa23c889d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.477313:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000750ff964/0x93d41aeaa23c889d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.477323:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000750ff964/0x93d41aeaa23c889d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.477329:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000750ff964/0x93d41aeaa23c889d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.477341:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.477343:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.477351:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787387948.478079:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787387948.478088:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716701f6/0x93d41aeaa23c88a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478099:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1787387948.478101:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387948.478105:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000716701f6/0x93d41aeaa23c88a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478118:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000716701f6/0x93d41aeaa23c88a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478127:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716701f6/0x93d41aeaa23c88a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478134:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000716701f6/0x93d41aeaa23c88a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478151:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.478160:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.478164:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000716701f6/0x93d41aeaa23c88a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478171:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fd400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.478174:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000716701f6/0x93d41aeaa23c88a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478191:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000716701f6/0x93d41aeaa23c88a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478203:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000716701f6/0x93d41aeaa23c88a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478210:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000716701f6/0x93d41aeaa23c88a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478224:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.478226:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.478228:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787387948.478647:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787387948.478653:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d768992d/0x93d41aeaa23c88ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478661:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1787387948.478664:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387948.478668:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d768992d/0x93d41aeaa23c88ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478676:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d768992d/0x93d41aeaa23c88ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478683:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d768992d/0x93d41aeaa23c88ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478697:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d768992d/0x93d41aeaa23c88ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478710:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.478718:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.478721:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d768992d/0x93d41aeaa23c88ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478728:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90a00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.478732:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d768992d/0x93d41aeaa23c88ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478765:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d768992d/0x93d41aeaa23c88ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478777:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d768992d/0x93d41aeaa23c88ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478784:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d768992d/0x93d41aeaa23c88ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.478798:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.478799:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.478801:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787387948.479192:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787387948.479205:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d93ee6e2/0x93d41aeaa23c88b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479214:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1787387948.479217:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387948.479222:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d93ee6e2/0x93d41aeaa23c88b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479231:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d93ee6e2/0x93d41aeaa23c88b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479239:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d93ee6e2/0x93d41aeaa23c88b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479246:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d93ee6e2/0x93d41aeaa23c88b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479259:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.479267:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.479270:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d93ee6e2/0x93d41aeaa23c88b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479277:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90200 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.479280:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d93ee6e2/0x93d41aeaa23c88b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479288:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d93ee6e2/0x93d41aeaa23c88b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479305:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d93ee6e2/0x93d41aeaa23c88b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479313:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d93ee6e2/0x93d41aeaa23c88b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479326:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.479329:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.479330:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787387948.479702:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787387948.479708:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017272a41/0x93d41aeaa23c88b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479716:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1787387948.479719:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387948.479724:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017272a41/0x93d41aeaa23c88b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479732:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017272a41/0x93d41aeaa23c88b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479761:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017272a41/0x93d41aeaa23c88b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479769:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017272a41/0x93d41aeaa23c88b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479792:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.479800:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.479803:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017272a41/0x93d41aeaa23c88b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479810:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91a00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.479813:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017272a41/0x93d41aeaa23c88b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479821:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017272a41/0x93d41aeaa23c88b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479832:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017272a41/0x93d41aeaa23c88b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479839:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017272a41/0x93d41aeaa23c88b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.479851:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.479852:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.479853:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.480536:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787387948.481625:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787387948.481637:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c88c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.481652:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787387948.481656:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387948.481662:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c88c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.481674:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c88c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.481694:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c88c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.481702:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c88c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.481731:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787387948.482144:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787387948.482149:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c88c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.482157:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787387948.482160:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387948.482163:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c88c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.482171:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c88c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.482178:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c88c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.482185:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c88c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.482210:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787387948.482354:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787387948.482362:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c88c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.482369:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70200 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387948.482373:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c88c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.482381:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c88c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.482413:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c88c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.482420:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c88c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.482438:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387948.482441:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c88c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.482447:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387948.482450:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c88c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.482457:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c88c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.482467:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c88c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.482473:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000144cbf7d/0x93d41aeaa23c88c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.482483:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.482484:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.482491:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.482579:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787387948.483012:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787387948.483019:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c88ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.483027:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787387948.483030:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387948.483034:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c88ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.483042:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c88ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.483049:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c88ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.483056:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c88ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.483073:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787387948.484970:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787387948.484992:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ad626df/0x93d41aeaa23c88d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485006:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1787387948.485015:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387948.485021:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ad626df/0x93d41aeaa23c88d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485033:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ad626df/0x93d41aeaa23c88d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485043:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ad626df/0x93d41aeaa23c88d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485050:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ad626df/0x93d41aeaa23c88d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485068:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787387948.485080:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387948.485086:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c88ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485093:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70c00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.485098:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c88ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485107:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c88ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485127:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c88ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485144:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c88ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485164:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.485167:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ad626df/0x93d41aeaa23c88d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485174:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.485178:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ad626df/0x93d41aeaa23c88d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485185:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ad626df/0x93d41aeaa23c88d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485195:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ad626df/0x93d41aeaa23c88d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485202:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ad626df/0x93d41aeaa23c88d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485225:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.485227:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.485229:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787387948.485677:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787387948.485683:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef8606aa/0x93d41aeaa23c88dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485698:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1787387948.485701:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387948.485705:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef8606aa/0x93d41aeaa23c88dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485713:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef8606aa/0x93d41aeaa23c88dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485721:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef8606aa/0x93d41aeaa23c88dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485729:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef8606aa/0x93d41aeaa23c88dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485762:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.485770:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.485774:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef8606aa/0x93d41aeaa23c88dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485781:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91200 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.485784:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef8606aa/0x93d41aeaa23c88dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485792:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef8606aa/0x93d41aeaa23c88dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485814:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef8606aa/0x93d41aeaa23c88dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485820:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef8606aa/0x93d41aeaa23c88dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.485832:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.485834:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.485836:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.486191:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787387948.486227:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787387948.486232:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084dca353/0x93d41aeaa23c88e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.486242:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1787387948.486245:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387948.486249:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084dca353/0x93d41aeaa23c88e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.486257:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084dca353/0x93d41aeaa23c88e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.486266:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084dca353/0x93d41aeaa23c88e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.486273:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084dca353/0x93d41aeaa23c88e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.486312:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787387948.486333:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387948.486338:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084dca353/0x93d41aeaa23c88e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.486346:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90e00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387948.486349:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084dca353/0x93d41aeaa23c88e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.486357:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084dca353/0x93d41aeaa23c88e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.486372:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084dca353/0x93d41aeaa23c88e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.486379:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084dca353/0x93d41aeaa23c88e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.486406:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.486408:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.486410:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787387948.493339:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787387948.493355:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc20e5f7/0x93d41aeaa23c88ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.493373:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1787387948.493377:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387948.493384:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc20e5f7/0x93d41aeaa23c88ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.493399:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc20e5f7/0x93d41aeaa23c88ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.493410:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc20e5f7/0x93d41aeaa23c88ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.493418:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc20e5f7/0x93d41aeaa23c88ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.493437:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.493450:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.493456:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc20e5f7/0x93d41aeaa23c88ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.493464:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91e00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.493475:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc20e5f7/0x93d41aeaa23c88ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.493485:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc20e5f7/0x93d41aeaa23c88ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.493501:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc20e5f7/0x93d41aeaa23c88ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.493508:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc20e5f7/0x93d41aeaa23c88ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.493530:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.493532:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.493533:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787387948.496831:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787387948.496842:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059b57bc3/0x93d41aeaa23c88f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.496858:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1787387948.496863:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387948.496868:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059b57bc3/0x93d41aeaa23c88f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.496882:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059b57bc3/0x93d41aeaa23c88f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497099:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059b57bc3/0x93d41aeaa23c88f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497112:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059b57bc3/0x93d41aeaa23c88f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497133:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787387948.497234:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787387948.497242:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032659bd1/0x93d41aeaa23c88f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.497249:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1787387948.497252:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387948.497256:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032659bd1/0x93d41aeaa23c88f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.497266:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032659bd1/0x93d41aeaa23c88f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.497274:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032659bd1/0x93d41aeaa23c88f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.497287:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032659bd1/0x93d41aeaa23c88f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.497306:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787387948.497381:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387948.497389:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059b57bc3/0x93d41aeaa23c88f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497397:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91c00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.497402:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059b57bc3/0x93d41aeaa23c88f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497411:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059b57bc3/0x93d41aeaa23c88f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497428:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059b57bc3/0x93d41aeaa23c88f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497435:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059b57bc3/0x93d41aeaa23c88f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497454:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.497458:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032659bd1/0x93d41aeaa23c88f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497474:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.497477:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032659bd1/0x93d41aeaa23c88f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497485:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032659bd1/0x93d41aeaa23c88f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497495:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032659bd1/0x93d41aeaa23c88f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497503:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032659bd1/0x93d41aeaa23c88f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497515:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.497517:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.497519:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787387948.497717:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787387948.497723:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8846b43/0x93d41aeaa23c88ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.497731:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1787387948.497734:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387948.497753:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8846b43/0x93d41aeaa23c88ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.497763:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8846b43/0x93d41aeaa23c88ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.497771:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8846b43/0x93d41aeaa23c88ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.497778:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8846b43/0x93d41aeaa23c88ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.497796:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.497800:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.497804:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8846b43/0x93d41aeaa23c88ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497812:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152ea00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.497815:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8846b43/0x93d41aeaa23c88ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497823:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8846b43/0x93d41aeaa23c88ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497839:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8846b43/0x93d41aeaa23c88ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497847:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8846b43/0x93d41aeaa23c88ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.497858:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.497860:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.497862:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.498687:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.501468:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.501482:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000894772ba/0x93d41aeaa23c8906 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.501500:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.501514:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.501521:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000894772ba/0x93d41aeaa23c8906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.501537:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000894772ba/0x93d41aeaa23c8906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.501548:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000894772ba/0x93d41aeaa23c8906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.501556:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000894772ba/0x93d41aeaa23c8906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.501579:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.502088:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.502097:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000894772ba/0x93d41aeaa23c8906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.502106:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340031000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.502111:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000894772ba/0x93d41aeaa23c8906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.502120:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000894772ba/0x93d41aeaa23c8906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.502137:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000894772ba/0x93d41aeaa23c8906 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.502145:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000894772ba/0x93d41aeaa23c8906 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.502176:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.502178:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.502179:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.502240:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.502247:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a3df065/0x93d41aeaa23c890d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.502255:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.502258:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.502263:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a3df065/0x93d41aeaa23c890d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.502271:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a3df065/0x93d41aeaa23c890d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.502278:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a3df065/0x93d41aeaa23c890d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.502291:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a3df065/0x93d41aeaa23c890d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.502311:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.502652:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.502659:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a3df065/0x93d41aeaa23c890d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.502666:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340031600 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.502670:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a3df065/0x93d41aeaa23c890d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.502676:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a3df065/0x93d41aeaa23c890d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.502800:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a3df065/0x93d41aeaa23c890d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.502808:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a3df065/0x93d41aeaa23c890d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.502823:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.502825:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.502827:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.504132:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.504142:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084ae083/0x93d41aeaa23c8914 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.504155:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.504159:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.504165:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084ae083/0x93d41aeaa23c8914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.504176:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000084ae083/0x93d41aeaa23c8914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.504184:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084ae083/0x93d41aeaa23c8914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.504190:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000084ae083/0x93d41aeaa23c8914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.504204:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787387948.504368:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787387948.504374:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c891b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.504389:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1787387948.504466:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387948.504471:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c891b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.504481:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c891b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.504488:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c891b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.504495:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c891b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.504507:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787387948.505614:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787387948.505624:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c8922 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.505635:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1787387948.505639:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387948.505644:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c8922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.505654:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c8922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.505675:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c8922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.505683:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c8922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.505693:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787387948.506093:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.506100:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c659cb68/0x93d41aeaa23c8929 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.506113:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.506116:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.506121:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c659cb68/0x93d41aeaa23c8929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.506131:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c659cb68/0x93d41aeaa23c8929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.506140:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c659cb68/0x93d41aeaa23c8929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.506147:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c659cb68/0x93d41aeaa23c8929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.506155:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787387948.507036:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.507046:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb6aff0/0x93d41aeaa23c8930 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.507056:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.507059:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.507063:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb6aff0/0x93d41aeaa23c8930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.507073:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcb6aff0/0x93d41aeaa23c8930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.507090:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb6aff0/0x93d41aeaa23c8930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507132:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787387948.507139:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000084ae083/0x93d41aeaa23c8914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507148:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030e00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387948.507153:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000084ae083/0x93d41aeaa23c8914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507162:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000084ae083/0x93d41aeaa23c8914 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507184:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000084ae083/0x93d41aeaa23c8914 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507192:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000084ae083/0x93d41aeaa23c8914 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507231:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787387948.507241:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c891b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507249:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f200 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387948.507252:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c891b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507260:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c891b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507272:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c891b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507279:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c891b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507293:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787387948.507296:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c8922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507302:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387948.507305:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c8922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507311:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c8922 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507332:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c8922 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507339:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c8922 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507351:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387948.507354:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c659cb68/0x93d41aeaa23c8929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507360:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030800 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387948.507363:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c659cb68/0x93d41aeaa23c8929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507370:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c659cb68/0x93d41aeaa23c8929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507380:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c659cb68/0x93d41aeaa23c8929 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507387:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c659cb68/0x93d41aeaa23c8929 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.507481:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.507483:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.507491:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.507957:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb6aff0/0x93d41aeaa23c8930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.508004:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787387948.508201:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387948.508207:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcb6aff0/0x93d41aeaa23c8930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.508215:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340031e00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387948.508218:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb6aff0/0x93d41aeaa23c8930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.508228:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb6aff0/0x93d41aeaa23c8930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.508242:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcb6aff0/0x93d41aeaa23c8930 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.508249:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcb6aff0/0x93d41aeaa23c8930 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.508271:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.508273:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.508274:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.510029:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.510042:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000750ff964/0x93d41aeaa23c8937 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.510058:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.510062:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.510067:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000750ff964/0x93d41aeaa23c8937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.510080:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000750ff964/0x93d41aeaa23c8937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.510089:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000750ff964/0x93d41aeaa23c8937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.510097:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000750ff964/0x93d41aeaa23c8937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.510135:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787387948.510627:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.510633:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc8b68d0/0x93d41aeaa23c893e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.510642:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.510646:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.510649:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc8b68d0/0x93d41aeaa23c893e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.510659:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc8b68d0/0x93d41aeaa23c893e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.510666:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc8b68d0/0x93d41aeaa23c893e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.510673:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc8b68d0/0x93d41aeaa23c893e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.510680:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787387948.511005:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787387948.511013:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000750ff964/0x93d41aeaa23c8937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.511020:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387948.511025:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000750ff964/0x93d41aeaa23c8937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.511045:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000750ff964/0x93d41aeaa23c8937 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.511061:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000750ff964/0x93d41aeaa23c8937 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.511068:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000750ff964/0x93d41aeaa23c8937 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.511087:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387948.511090:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc8b68d0/0x93d41aeaa23c893e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.511098:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030c00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387948.511101:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc8b68d0/0x93d41aeaa23c893e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.511109:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc8b68d0/0x93d41aeaa23c893e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.511119:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc8b68d0/0x93d41aeaa23c893e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.511125:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc8b68d0/0x93d41aeaa23c893e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.511148:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.511151:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.511153:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.511280:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.512302:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.512313:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c8945 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.512326:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.512335:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.512340:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c8945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.512353:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c8945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.512362:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c8945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.512370:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c8945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.512976:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787387948.513504:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.513512:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e23902/0x93d41aeaa23c894c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.513526:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.513529:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.513534:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083e23902/0x93d41aeaa23c894c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.513545:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083e23902/0x93d41aeaa23c894c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.513554:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e23902/0x93d41aeaa23c894c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.513567:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083e23902/0x93d41aeaa23c894c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.513576:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787387948.514128:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.514136:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c8953 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.514145:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.514148:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.514152:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c8953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.514160:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c8953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514162:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787387948.514169:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c8953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514170:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c8945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.514178:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c8953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.514187:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787387948.514189:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030a00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.514193:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c8945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514202:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c8945 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514219:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c8945 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514227:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000884e1747/0x93d41aeaa23c8945 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514245:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387948.514248:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083e23902/0x93d41aeaa23c894c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514254:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.514257:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e23902/0x93d41aeaa23c894c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514264:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e23902/0x93d41aeaa23c894c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514274:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083e23902/0x93d41aeaa23c894c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514286:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083e23902/0x93d41aeaa23c894c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514299:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.514302:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c8953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514308:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460aa00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.514311:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c8953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514319:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c8953 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514330:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c8953 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514337:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014733c57/0x93d41aeaa23c8953 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514347:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.514349:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.514351:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.514540:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.514546:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f5aedc9/0x93d41aeaa23c895a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.514558:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.514561:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.514566:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f5aedc9/0x93d41aeaa23c895a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.514576:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f5aedc9/0x93d41aeaa23c895a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.514584:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f5aedc9/0x93d41aeaa23c895a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.514591:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f5aedc9/0x93d41aeaa23c895a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.514603:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.514789:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.514793:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f5aedc9/0x93d41aeaa23c895a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514806:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ac00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.514809:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f5aedc9/0x93d41aeaa23c895a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514816:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f5aedc9/0x93d41aeaa23c895a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514827:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f5aedc9/0x93d41aeaa23c895a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514833:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f5aedc9/0x93d41aeaa23c895a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.514845:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.514846:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.514847:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.515029:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.515035:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8961 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.515043:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.515046:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.515050:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.515059:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.515077:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.515083:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.515094:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.515329:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.515334:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.515341:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460b400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.515344:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.515351:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.515368:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8961 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.515374:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e4faeb3/0x93d41aeaa23c8961 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.515387:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.515389:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.515390:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.515877:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.515884:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e204f7/0x93d41aeaa23c8968 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.515894:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.515897:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.515902:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097e204f7/0x93d41aeaa23c8968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.515912:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097e204f7/0x93d41aeaa23c8968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.515921:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e204f7/0x93d41aeaa23c8968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.515929:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097e204f7/0x93d41aeaa23c8968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.515969:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787387948.516409:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.516416:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000024e6967/0x93d41aeaa23c896f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.516425:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.516428:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.516432:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000024e6967/0x93d41aeaa23c896f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.516442:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000024e6967/0x93d41aeaa23c896f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.516451:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000024e6967/0x93d41aeaa23c896f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.516459:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000024e6967/0x93d41aeaa23c896f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.516468:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787387948.517555:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787387948.517564:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097e204f7/0x93d41aeaa23c8968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.517575:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a600 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387948.517580:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e204f7/0x93d41aeaa23c8968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.517590:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e204f7/0x93d41aeaa23c8968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.517606:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097e204f7/0x93d41aeaa23c8968 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.517613:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097e204f7/0x93d41aeaa23c8968 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.517631:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387948.517635:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000024e6967/0x93d41aeaa23c896f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.517641:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387948.517653:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000024e6967/0x93d41aeaa23c896f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.517660:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000024e6967/0x93d41aeaa23c896f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.517670:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000024e6967/0x93d41aeaa23c896f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.517677:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000024e6967/0x93d41aeaa23c896f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.517691:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.517692:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.517694:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.518193:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787387948.518620:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787387948.518629:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8976 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.518642:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787387948.518650:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387948.518657:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.518669:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.518678:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.518685:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8976 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.518704:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787387948.518714:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387948.518718:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8976 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.518724:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70c00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387948.518728:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8976 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.518735:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8976 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.518773:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8976 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.518789:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8976 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.518803:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.518804:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.518806:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787387948.519563:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787387948.519572:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d29ff72/0x93d41aeaa23c897d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.519582:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787387948.519586:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387948.519591:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d29ff72/0x93d41aeaa23c897d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.519600:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d29ff72/0x93d41aeaa23c897d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.519608:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d29ff72/0x93d41aeaa23c897d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.519615:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d29ff72/0x93d41aeaa23c897d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.519636:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.519645:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.519651:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d29ff72/0x93d41aeaa23c897d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.519659:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70e00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.519663:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d29ff72/0x93d41aeaa23c897d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.519672:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d29ff72/0x93d41aeaa23c897d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.519684:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d29ff72/0x93d41aeaa23c897d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.519692:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d29ff72/0x93d41aeaa23c897d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.519717:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.519718:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.519720:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787387948.520207:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787387948.520667:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c8984 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.520680:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787387948.520684:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387948.520688:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c8984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.520698:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c8984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.520707:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c8984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.520713:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c8984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.520730:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787387948.520760:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387948.520765:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c8984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.520772:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71e00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387948.520775:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c8984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.520782:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c8984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.520800:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c8984 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.520808:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2ea9089/0x93d41aeaa23c8984 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.520821:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.520823:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387948.520825:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.521141:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.521146:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe1081db/0x93d41aeaa23c898b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.521155:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.521164:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.521168:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe1081db/0x93d41aeaa23c898b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.521177:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe1081db/0x93d41aeaa23c898b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.521184:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe1081db/0x93d41aeaa23c898b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.521190:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe1081db/0x93d41aeaa23c898b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.521205:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.521440:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.521445:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe1081db/0x93d41aeaa23c898b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.521453:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a200 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.521457:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe1081db/0x93d41aeaa23c898b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.521464:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe1081db/0x93d41aeaa23c898b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.521482:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe1081db/0x93d41aeaa23c898b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.521489:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe1081db/0x93d41aeaa23c898b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.521504:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.521506:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.521507:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.522067:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.522074:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f76340/0x93d41aeaa23c8992 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.522083:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.522087:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.522091:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f76340/0x93d41aeaa23c8992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.522100:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8f76340/0x93d41aeaa23c8992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.522108:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f76340/0x93d41aeaa23c8992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.522120:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f76340/0x93d41aeaa23c8992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.522136:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787387948.522810:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.522817:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8999 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.522827:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.522831:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.522835:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.522845:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.522854:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.522862:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.522882:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787387948.522889:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387948.522895:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8f76340/0x93d41aeaa23c8992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.522914:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460be00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.522918:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f76340/0x93d41aeaa23c8992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.522926:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f76340/0x93d41aeaa23c8992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.522940:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8f76340/0x93d41aeaa23c8992 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.522959:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8f76340/0x93d41aeaa23c8992 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.522973:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.522977:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.522982:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a400 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.522985:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.522993:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8999 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.523002:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8999 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.523015:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f37f5ae/0x93d41aeaa23c8999 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.523028:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.523029:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.523031:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787387948.523735:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787387948.523758:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c89a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.523768:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1787387948.523772:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387948.523776:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c89a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.523786:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c89a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.523794:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c89a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.523806:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c89a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.523826:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.523831:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.523836:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c89a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.523844:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.523848:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c89a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.523856:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c89a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.523868:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c89a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.523876:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4fc83c0/0x93d41aeaa23c89a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.523889:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.523891:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.523892:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787387948.524190:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787387948.524195:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c89a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.524203:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1787387948.524206:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387948.524210:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c89a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387948.524552:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.524688:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.524695:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6d7c281/0x93d41aeaa23c89ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.524709:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.524712:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.524716:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6d7c281/0x93d41aeaa23c89ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.524725:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6d7c281/0x93d41aeaa23c89ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.524732:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6d7c281/0x93d41aeaa23c89ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.524818:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6d7c281/0x93d41aeaa23c89ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.524836:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787387948.525350:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c89a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.525360:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c89a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.525367:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c89a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.525429:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.525437:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6d7c281/0x93d41aeaa23c89ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.525445:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460a800 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.525449:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6d7c281/0x93d41aeaa23c89ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.525458:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6d7c281/0x93d41aeaa23c89ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.525473:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6d7c281/0x93d41aeaa23c89ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.525481:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6d7c281/0x93d41aeaa23c89ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.525498:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.525500:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.525502:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387948.525655:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787387948.526126:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787387948.526134:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1e2f/0x93d41aeaa23c89b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.526149:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1787387948.526152:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387948.526157:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1e2f/0x93d41aeaa23c89b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.526166:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1e2f/0x93d41aeaa23c89b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.526174:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1e2f/0x93d41aeaa23c89b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.526181:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1e2f/0x93d41aeaa23c89b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.526200:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787387948.526381:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387948.526388:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c89a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526395:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152f200 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.526399:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c89a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526420:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c89a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526432:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c89a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526438:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ee29e3c/0x93d41aeaa23c89a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526453:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.526456:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1e2f/0x93d41aeaa23c89b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526463:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e600 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.526465:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1e2f/0x93d41aeaa23c89b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526472:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1e2f/0x93d41aeaa23c89b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526480:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1e2f/0x93d41aeaa23c89b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526486:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac9a1e2f/0x93d41aeaa23c89b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526509:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.526511:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.526513:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787387948.526540:0:15604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787387948.526547:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c89bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.526554:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787387948.526557:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387948.526562:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c89bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.526571:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c89bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.526588:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c89bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.526596:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c89bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387948.526614:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.526619:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.526623:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c89bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526630:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ba00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.526634:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c89bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526641:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c89bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526652:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c89bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526659:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b35ebdfa/0x93d41aeaa23c89bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.526672:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.526674:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.526676:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787387948.526814:0:15604:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1787387948.526911:0:15604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14270:x1874211709751040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 101333us (113536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387948.526920:0:15604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787387948.526991:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a823b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14270:1874211709751040:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787387948.527005:0:14270:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787387948.527049:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a084e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14270:1874211709751168:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1787387948.527194:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387948.527237:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387948.527315:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464ee180 going to sleep for 11 seconds 00000100:00100000:3.0:1787387948.527331:0:15604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709751168 00000100:00100000:3.0:1787387948.527337:0:15604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709751168 00002000:00010000:1.0:1787387948.527728:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787387948.527750:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c659cb68/0x93d41aeaa23c89c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.527763:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1787387948.527767:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387948.527772:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c659cb68/0x93d41aeaa23c89c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.527782:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c659cb68/0x93d41aeaa23c89c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.527800:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c659cb68/0x93d41aeaa23c89c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.527807:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c659cb68/0x93d41aeaa23c89c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.527821:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787387948.528228:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787387948.528234:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084ae083/0x93d41aeaa23c89ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.528333:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.528339:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c659cb68/0x93d41aeaa23c89c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.528347:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1787387948.528350:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387948.528355:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084ae083/0x93d41aeaa23c89ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.528358:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030800 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.528362:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c659cb68/0x93d41aeaa23c89c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.528364:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084ae083/0x93d41aeaa23c89ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.528370:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c659cb68/0x93d41aeaa23c89c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.528372:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084ae083/0x93d41aeaa23c89ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.528380:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084ae083/0x93d41aeaa23c89ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.528385:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c659cb68/0x93d41aeaa23c89c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.528392:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c659cb68/0x93d41aeaa23c89c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387948.528409:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787387948.528410:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387948.528413:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084ae083/0x93d41aeaa23c89ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.528419:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030e00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387948.528422:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084ae083/0x93d41aeaa23c89ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.528430:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084ae083/0x93d41aeaa23c89ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.528440:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084ae083/0x93d41aeaa23c89ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.528452:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084ae083/0x93d41aeaa23c89ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387948.528464:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.528466:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387948.528468:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787387948.528573:0:14880:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1787387948.528642:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14268:x1874211709750784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 119837us (120665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387948.528651:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387948.528694:0:14268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a822a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14268:1874211709750784:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787387948.528706:0:14268:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787387948.528762:0:14268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a822a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14268:1874211709751296:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787387948.528790:0:14268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387948.528999:0:14268:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351228180 going to sleep for 11 seconds 00000100:00100000:0.0:1787387948.529026:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709751296 00000100:00100000:0.0:1787387948.529032:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709751296 00000100:00100000:0.0:1787387948.529060:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787387948.529068:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14270:x1874211709751168:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787387948.529108:0:14879:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1787387948.530510:0:15604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387948.530527:0:15604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14268:x1874211709751296:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787387948.530559:0:15604:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:2.0:1787387948.530882:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787387948.530999:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787387948.534086:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387948.537274:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14270:x1874211709751168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8198us (10028us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787387948.537287:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787387948.537385:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a084e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14270:1874211709751168:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787387948.539402:0:14270:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787387948.541178:0:15604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14268:x1874211709751296:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10650us (12380us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787387948.541190:0:15604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787387948.541423:0:14268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a822a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14268:1874211709751296:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787387948.541438:0:14268:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 10000000:01000000:3.0:1787387949.085832:0:14243:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787387949.085840:0:14243:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d437a1bb000 from 8 10000000:01000000:3.0:1787387949.085845:0:14243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787387949.085896:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460b800/0x93d41aeaa23c89d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.085909:0:14243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d437460b800/0x93d41aeaa23c89d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.085920:0:14243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d437460b800/0x93d41aeaa23c89d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387949.085957:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709751424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787387949.086033:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.086084:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43464ee540 going to sleep for 11 seconds 00000100:00100000:1.0:1787387949.086673:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709751424 00000100:00100000:1.0:1787387949.086681:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709751424 00000100:00100000:1.0:1787387949.086755:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787387949.086765:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:14243:x1874211709751424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387949.086779:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387949.086794:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4340030c00/0x93d41aeaa23c89d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c89d1 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.086816:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340030c00/0x93d41aeaa23c89d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c89d1 expref: 19 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.086827:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4340030c00/0x93d41aeaa23c89d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c89d1 expref: 19 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.086847:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340030c00, rc 0) 00000100:00100000:1.0:1787387949.086903:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:14243:x1874211709751424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387949.086910:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787387949.086971:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709751424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387949.086990:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d437460b800/0x93d41aeaa23c89d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c89d8 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.086999:0:14243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d437460b800/0x93d41aeaa23c89d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c89d8 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387949.087048:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a822680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709751552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787387949.087079:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387949.087098:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351228540 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.087220:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709751552 00000100:00100000:2.0:1787387949.087225:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709751552 00000100:00100000:2.0:1787387949.087257:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787387949.087264:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4377cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:14243:x1874211709751552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787387949.087278:0:14237:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787387949.087293:0:14237:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787387949.087296:0:14237:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787387949.087367:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4377cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:14243:x1874211709751552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.087374:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387949.087725:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a822680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709751552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787387949.087809:0:14243:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787387949.087816:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460b800/0x93d41aeaa23c89d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c89d8 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.087825:0:14243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d437460b800/0x93d41aeaa23c89d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c89d8 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.538213:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787387950.347220:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787387950.347246:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1787387950.558854:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387951.585550:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387952.606436:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787387952.835370:0:7514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787387952.835390:0:7514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787387953.634888:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387953.758239:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709751680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387953.758310:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387953.758434:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709751680 00000100:00100000:1.0:1787387953.758443:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709751680 00000100:00100000:1.0:1787387953.758504:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387953.758514:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709751680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387953.758560:0:14884:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387953.758607:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709751680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387953.758615:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387953.758657:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787387953.758678:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709751680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387953.758828:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709751808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387953.758869:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.758902:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709751808 00000100:00100000:2.0:1787387953.758906:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709751808 00000100:00080000:0.0:1787387953.759040:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787387953.759044:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387953.759071:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387953.759079:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709751808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387953.759099:0:14884:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387953.759132:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709751808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.759139:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387953.759163:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787387953.759177:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709751808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387953.759285:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709752064:0@lo:400:kworker.0 00000100:00100000:0.0:1787387953.759315:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387953.759333:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387953.759339:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3312:1874211709751936:0@lo:400:kworker.0 00000100:00100000:0.0:1787387953.759366:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.759504:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709752064 00000100:00100000:2.0:1787387953.759509:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709752064 00000100:00100000:2.0:1787387953.759543:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387953.759549:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709752064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387953.759589:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709752064:12345-0@lo:400:kworker.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.759595:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387953.759613:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709751936 00000100:00100000:2.0:1787387953.759616:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709751936 00000100:00100000:2.0:1787387953.759638:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787387953.759644:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3312:x1874211709751936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387953.759672:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3312:x1874211709751936:12345-0@lo:400:kworker.0 Request processed in 28us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.759678:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787387953.759714:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3312:1874211709751936:0@lo:400:kworker.0 00010000:00080000:2.0:1787387953.759726:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437ab44e00 x1874211709752064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387953.759774:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709752064:0@lo:400:kworker.0 00000100:00100000:2.0:1787387953.759805:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709752320:0@lo:400:kworker.0 00000100:00100000:2.0:1787387953.759832:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.759864:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387953.759870:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709752192:0@lo:400:kworker.0 00000100:00100000:2.0:1787387953.759893:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387953.759914:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709752320 00000100:00100000:2.0:1787387953.759917:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709752320 00000100:00100000:2.0:1787387953.759955:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709752192 00000100:00100000:2.0:1787387953.759958:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709752192 00000100:00100000:2.0:1787387953.759972:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387953.759977:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709752320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387953.760010:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874211709752320:12345-0@lo:400:kworker.0 Request processed in 32us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.760015:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387953.760026:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387953.760031:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709752192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387953.760055:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874211709752192:12345-0@lo:400:kworker.0 Request processed in 23us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387953.760060:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787387953.760073:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787387953.760095:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437ab44a80 x1874211709752192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387953.760104:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874211709752192:0@lo:400:kworker.0 00010000:00080000:2.0:1787387953.760113:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d437ab45500 x1874211709752320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387953.760131:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874211709752320:0@lo:400:kworker.0 00000001:02000400:1.0:1787387953.846721:0:15906:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787387954.654105:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787387954.911176:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787387955.680856:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387956.444548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387956.444771:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690882176 00000100:00100000:0.0:1787387956.444785:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690882176 00000100:00100000:0.0:1787387956.444878:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:0.0:1787387956.444889:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2349:x1874211690882176:12345-192.168.204.59@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787387956.444932:0:14239:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 12f74adc-05ae-4131-a2a8-f9c8cd73affb@192.168.204.59@tcp t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1787387956.445002:0:14239:0:(genops.c:1406:class_connect()) connect: client 12f74adc-05ae-4131-a2a8-f9c8cd73affb, cookie 0x93d41aeaa23c89df 00000100:00080000:0.0:1787387956.445612:0:14239:0:(import.c:65:import_set_state_nolock()) ffff8d4381c60800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387956.446679:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+5:2349:x1874211690882176:12345-192.168.204.59@tcp:250:mount.lustre.0 Request processed in 1779us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387956.446703:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:2.0:1787387956.461140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387956.461459:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690882304 00000100:00100000:3.0:1787387956.461474:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690882304 00000100:00100000:3.0:1787387956.461557:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:3.0:1787387956.461569:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+5:13717:x1874211690882304:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787387956.461596:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387956.461626:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d437460ba00/0x93d41aeaa23c89e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52bf9 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387956.461669:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d437460ba00/0x93d41aeaa23c89e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bf9 expref: 6 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387956.461683:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d437460ba00/0x93d41aeaa23c89e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52bf9 expref: 6 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387956.462022:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460ba00, rc 0) 00000100:00100000:3.0:1787387956.462123:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+6:13717:x1874211690882304:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 554us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387956.462132:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:3.0:1787387956.465946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387956.466211:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690882432 00000100:00100000:0.0:1787387956.466226:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690882432 00000100:00100000:0.0:1787387956.466360:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:0.0:1787387956.466377:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+6:13717:x1874211690882432:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787387956.467562:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+6:13717:x1874211690882432:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 1182us (1621us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787387956.467575:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:1.0:1787387956.474094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387956.474182:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690882560 00000100:00100000:3.0:1787387956.474196:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690882560 00000100:00100000:3.0:1787387956.474279:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:3.0:1787387956.474293:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+6:13717:x1874211690882560:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787387956.474318:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387956.474347:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d437460a800/0x93d41aeaa23c89ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52c00 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387956.474386:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d437460a800/0x93d41aeaa23c89ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c00 expref: 7 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387956.474412:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d437460a800/0x93d41aeaa23c89ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c00 expref: 7 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387956.474423:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a800, rc 0) 00000100:00100000:3.0:1787387956.474510:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+7:13717:x1874211690882560:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 220us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387956.474518:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:2.0:1787387956.480994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387956.481556:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690882688 00000100:00100000:0.0:1787387956.481572:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690882688 00000100:00100000:0.0:1787387956.481711:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:0.0:1787387956.481734:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+7:13717:x1874211690882688:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787387956.482270:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+8:13717:x1874211690882688:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 546us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387956.482280:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:0.0:1787387956.486912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387956.487030:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690882816 00000100:00100000:2.0:1787387956.487048:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690882816 00000100:00100000:2.0:1787387956.487132:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:2.0:1787387956.487146:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+8:13717:x1874211690882816:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787387956.488622:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+8:13717:x1874211690882816:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 590us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.488646:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:1.0:1787387956.500598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387956.500953:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690882944 00000100:00100000:0.0:1787387956.500967:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690882944 00000100:00100000:0.0:1787387956.501047:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:0.0:1787387956.501059:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+8:13735:x1874211690882944:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787387956.501674:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+8:13735:x1874211690882944:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 612us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387956.501687:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:0.0:1787387956.527441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387956.528377:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690883072 00000100:00100000:2.0:1787387956.528394:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690883072 00000100:00100000:2.0:1787387956.528484:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:2.0:1787387956.528497:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+8:13735:x1874211690883072:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787387956.529020:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+8:13735:x1874211690883072:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 516us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.529031:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:3.0:1787387956.541886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387956.543844:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690883200 00000100:00100000:0.0:1787387956.543869:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690883200 00000100:00100000:0.0:1787387956.543973:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:0.0:1787387956.543987:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+8:13717:x1874211690883200:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787387956.544011:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387956.544036:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4377c71000/0x93d41aeaa23c89f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52c2a expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387956.544076:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4377c71000/0x93d41aeaa23c89f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c2a expref: 9 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387956.544124:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4377c71000/0x93d41aeaa23c89f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c2a expref: 9 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387956.544137:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71000, rc 0) 00000100:00100000:0.0:1787387956.544249:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+9:13717:x1874211690883200:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 264us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387956.544258:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:1.0:1787387956.556479:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387956.556713:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690883328 00000100:00100000:3.0:1787387956.556728:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690883328 00000100:00100000:3.0:1787387956.556869:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:3.0:1787387956.556880:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+9:13717:x1874211690883328:12345-192.168.204.59@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787387956.556917:0:14238:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787387956.556970:0:14238:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787387956.556975:0:14238:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787387956.556979:0:14238:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787387956.556982:0:14238:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787387956.559920:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+9:13717:x1874211690883328:12345-192.168.204.59@tcp:256:mount.lustre.0 Request processed in 3024us (3437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387956.559939:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:1.0:1787387956.566297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387956.567382:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690883456 00000100:00100000:2.0:1787387956.567406:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690883456 00000100:00100000:2.0:1787387956.567606:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:2.0:1787387956.567620:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+9:13717:x1874211690883456:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787387956.567644:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387956.567670:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f90400/0x93d41aeaa23c89fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52c31 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387956.569924:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f90400/0x93d41aeaa23c89fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c31 expref: 10 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387956.569950:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f90400/0x93d41aeaa23c89fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c31 expref: 10 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387956.569964:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90400, rc 0) 00000100:00100000:2.0:1787387956.570071:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+10:13717:x1874211690883456:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 2452us (3788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.570082:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:1.0:1787387956.573988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387956.574084:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690883584 00000100:00100000:3.0:1787387956.574098:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690883584 00000100:00100000:3.0:1787387956.574206:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:3.0:1787387956.574220:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+10:13717:x1874211690883584:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787387956.574913:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+10:13717:x1874211690883584:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 693us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387956.574925:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:1.0:1787387956.582511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387956.582826:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690883712 00000100:00100000:2.0:1787387956.582841:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690883712 00000100:00100000:2.0:1787387956.582968:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:2.0:1787387956.582981:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+10:13717:x1874211690883712:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787387956.583332:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+10:13717:x1874211690883712:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 342us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.583342:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:1.0:1787387956.594980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387956.595271:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690883840 00000100:00100000:2.0:1787387956.595285:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690883840 00000100:00100000:2.0:1787387956.595359:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:2.0:1787387956.595370:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4374023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+10:13740:x1874211690883840:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787387956.596012:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4374023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+10:13740:x1874211690883840:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 639us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.596026:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:1.0:1787387956.609987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387956.610516:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690883968 00000100:00100000:2.0:1787387956.610554:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690883968 00000100:00100000:2.0:1787387956.610643:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:2.0:1787387956.610657:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+10:13740:x1874211690883968:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787387956.614056:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+10:13740:x1874211690883968:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 3385us (4072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.614074:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:1.0:1787387956.631696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387956.631945:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690884096 00000100:00100000:2.0:1787387956.631955:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690884096 00000100:00100000:2.0:1787387956.632014:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1787387956.632023:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1874211690884096:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787387956.632055:0:14246:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 396e9ca3-e412-469b-a169-aad215faf0ba@192.168.204.59@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:2.0:1787387956.632109:0:14246:0:(genops.c:1406:class_connect()) connect: client 396e9ca3-e412-469b-a169-aad215faf0ba, cookie 0x93d41aeaa23c8a02 00000004:00100000:2.0:1787387956.632142:0:14246:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:2.0:1787387956.632149:0:14246:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787387956.659020:0:14246:0:(import.c:65:import_set_state_nolock()) ffff8d43471b3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387956.659109:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+6:2349:x1874211690884096:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 27084us (27429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.659120:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1787387956.666425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387956.666523:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690884352 00000100:00100000:2.0:1787387956.666532:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690884352 00000100:00100000:2.0:1787387956.666659:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1787387956.666671:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+6:13717:x1874211690884352:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787387956.666725:0:14245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787387956.666853:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+6:13717:x1874211690884352:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 185us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.666879:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00080000:0.0:1787387956.669263:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387956.670298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387956.670428:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690884224 00000100:00100000:2.0:1787387956.670439:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690884224 00000100:00100000:2.0:1787387956.670499:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:2.0:1787387956.670510:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+6:0:x1874211690884224:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787387956.670541:0:14246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787387956.670611:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+6:0:x1874211690884224:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 102us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.670619:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1787387956.675204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387956.675284:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690884480 00000100:00100000:3.0:1787387956.675295:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690884480 00000100:00100000:3.0:1787387956.675363:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1787387956.675375:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+6:13717:x1874211690884480:12345-192.168.204.59@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787387956.675506:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+6:13717:x1874211690884480:12345-192.168.204.59@tcp:40:mount.lustre.0 Request processed in 133us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387956.675513:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1787387956.688670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387956.688874:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387956.688942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387956.689038:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690884608 00000100:00100000:1.0:1787387956.689049:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690884608 00000100:00100000:1.0:1787387956.689088:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690884736 00000100:00100000:1.0:1787387956.689093:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690884736 00000100:00100000:1.0:1787387956.689117:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1787387956.689126:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874211690884608:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787387956.689166:0:14881:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 396e9ca3-e412-469b-a169-aad215faf0ba@192.168.204.59@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1787387956.689214:0:14881:0:(genops.c:1406:class_connect()) connect: client 396e9ca3-e412-469b-a169-aad215faf0ba, cookie 0x93d41aeaa23c8a09 00002000:00100000:1.0:1787387956.689226:0:14881:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 396e9ca3-e412-469b-a169-aad215faf0ba/ffff8d42411a2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787387956.689263:0:14881:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787387956.689581:0:14881:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787387956.689609:0:14881:0:(import.c:65:import_set_state_nolock()) ffff8d42411a0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387956.689679:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:396e9ca3-e412-469b-a169-aad215faf0ba+6:2349:x1874211690884608:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 552us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387956.689700:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1787387956.689720:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1787387956.689726:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874211690884736:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787387956.689770:0:14881:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 396e9ca3-e412-469b-a169-aad215faf0ba@192.168.204.59@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1787387956.689800:0:14881:0:(genops.c:1406:class_connect()) connect: client 396e9ca3-e412-469b-a169-aad215faf0ba, cookie 0x93d41aeaa23c8a10 00002000:00100000:1.0:1787387956.689807:0:14881:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 396e9ca3-e412-469b-a169-aad215faf0ba/ffff8d42411a1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787387956.689822:0:14881:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787387956.690019:0:14881:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787387956.690035:0:14881:0:(import.c:65:import_set_state_nolock()) ffff8d42411a4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387956.690062:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:396e9ca3-e412-469b-a169-aad215faf0ba+6:2349:x1874211690884736:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 334us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387956.690069:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1787387956.693920:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690884864 00000100:00100000:2.0:1787387956.693936:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690884864 00000100:00100000:2.0:1787387956.694065:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:2.0:1787387956.694077:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+6:13717:x1874211690884864:12345-192.168.204.59@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787387956.697352:0:14248:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3199us 00010000:00010000:2.0:1787387956.702082:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:3.0:1787387956.716038:0:14248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787387956.716208:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+6:13717:x1874211690884864:12345-192.168.204.59@tcp:33:mount.lustre.0 Request processed in 22128us (27542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387956.716222:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1787387956.878211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387956.878336:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690884992 00000100:00100000:1.0:1787387956.878347:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690884992 00000100:00100000:1.0:1787387956.878411:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:1.0:1787387956.878421:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+6:13761:x1874211690884992:12345-192.168.204.59@tcp:101:mkdir.0 00010000:00010000:1.0:1787387956.878455:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387956.878481:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031e00/0x93d41aeaa23c8a17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52c5b expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387956.878549:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8a1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387956.878564:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387956.878579:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387956.878887:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787387956.878892:0:14245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787387956.878974:0:14245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387956.879000:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031e00/0x93d41aeaa23c8a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c5b expref: 8 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387956.879017:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8a1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c5b expref: 7 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387956.879026:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720600) 00010000:00010000:1.0:1787387956.879028:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787387956.879031:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340030400, rc 0) 00000100:00100000:1.0:1787387956.879112:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+7:13761:x1874211690884992:12345-192.168.204.59@tcp:101:mkdir.0 Request processed in 684us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387956.879120:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00010000:00010000:3.0:1787387957.726004:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787387957.961123:0:7514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 396e9ca3-e412-469b-a169-aad215faf0ba 00010000:00010000:2.0:1787387958.750275:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387958.878658:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387958.878685:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709752448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387958.878793:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387958.878977:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709752448 00000100:00100000:2.0:1787387958.878986:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709752448 00000100:00100000:2.0:1787387958.879061:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387958.879072:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709752448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387958.879111:0:14884:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387958.879449:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709752448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 378us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387958.879457:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787387958.879482:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387958.879537:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709752448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387958.880187:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709752960:0@lo:400:kworker.0 00000100:00100000:3.0:1787387958.880237:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387958.880262:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787387958.880267:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709752576:0@lo:400:kworker.0 00000100:00100000:3.0:1787387958.880296:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387958.880319:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709753088:0@lo:400:kworker.0 00000100:00100000:3.0:1787387958.880341:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387958.880477:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709752576 00000100:00100000:0.0:1787387958.880484:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709752576 00000100:00100000:0.0:1787387958.880528:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787387958.880537:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3311:x1874211709752576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387958.880584:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3311:x1874211709752576:12345-0@lo:400:kworker.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387958.880591:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787387958.880640:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709752576:0@lo:400:kworker.0 00000100:00100000:2.0:1787387958.880800:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709752704:0@lo:400:kworker.0 00000100:00100000:2.0:1787387958.880829:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387958.880847:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709753216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387958.880868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387958.880886:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387958.880892:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709752832:0@lo:400:kworker.0 00000100:00100000:2.0:1787387958.880913:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387958.880943:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709752960 00000100:00100000:2.0:1787387958.880947:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709752960 00000100:00100000:2.0:1787387958.880978:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709753088 00000100:00100000:2.0:1787387958.880981:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709753088 00000100:00100000:2.0:1787387958.880994:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709752832 00000100:00100000:2.0:1787387958.880996:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709752832 00000100:00100000:2.0:1787387958.881009:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387958.881015:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709752960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387958.881049:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709752960:12345-0@lo:400:kworker.0 Request processed in 34us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387958.881055:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387958.881068:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387958.881075:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709753088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387958.881101:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709753088:12345-0@lo:400:kworker.0 Request processed in 27us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387958.881106:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387958.881117:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387958.881123:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709752832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387958.881261:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709753216 00000100:00100000:1.0:1787387958.881266:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709753216 00000100:00100000:1.0:1787387958.881297:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787387958.881305:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709753216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387958.881332:0:14884:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387958.881373:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709753216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387958.881378:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787387958.881405:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387958.881409:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387958.881678:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709753216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387958.881778:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709752704 00000100:00100000:0.0:1787387958.881784:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709752704 00000100:00100000:0.0:1787387958.881870:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387958.881879:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709752704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387958.881922:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709752704:12345-0@lo:400:kworker.0 Request processed in 45us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387958.881938:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387958.881966:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709752704:0@lo:400:kworker.0 00000100:00100000:0.0:1787387958.881996:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709753088:0@lo:400:kworker.0 00000100:00100000:0.0:1787387958.882007:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709752960:0@lo:400:kworker.0 00000100:00100000:2.0:1787387958.882126:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709752832:12345-0@lo:400:kworker.0 Request processed in 1001us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387958.882134:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787387958.882483:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709752832:0@lo:400:kworker.0 00000100:00100000:2.0:1787387958.934698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387958.934857:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690885120 00000100:00100000:1.0:1787387958.934868:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690885120 00000100:00100000:1.0:1787387958.934941:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1787387958.934959:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+7:13814:x1874211690885120:12345-192.168.204.59@tcp:41:lfs.0 00000004:00000024:1.0:1787387958.935012:0:14245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787387958.935108:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+7:13814:x1874211690885120:12345-192.168.204.59@tcp:41:lfs.0 Request processed in 158us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387958.935117:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00080000:2.0:1787387958.935241:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387958.938226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387958.938352:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690885248 00000100:00100000:1.0:1787387958.938362:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690885248 00000100:00100000:1.0:1787387958.938830:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1787387958.938844:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:396e9ca3-e412-469b-a169-aad215faf0ba+6:13814:x1874211690885248:12345-192.168.204.59@tcp:13:lfs.0 00002000:00000024:1.0:1787387958.938870:0:14884:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787387958.938969:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:396e9ca3-e412-469b-a169-aad215faf0ba+6:13814:x1874211690885248:12345-192.168.204.59@tcp:13:lfs.0 Request processed in 128us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387958.938978:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00080000:2.0:1787387958.938991:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387958.944093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387958.944230:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690885376 00000100:00100000:3.0:1787387958.944243:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690885376 00000100:00080000:2.0:1787387958.944363:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387958.944545:0:14883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1787387958.944559:0:14883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:396e9ca3-e412-469b-a169-aad215faf0ba+5:13814:x1874211690885376:12345-192.168.204.59@tcp:13:lfs.0 00002000:00000024:3.0:1787387958.944583:0:14883:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387958.944673:0:14883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:396e9ca3-e412-469b-a169-aad215faf0ba+5:13814:x1874211690885376:12345-192.168.204.59@tcp:13:lfs.0 Request processed in 118us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387958.944690:0:14883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:0.0:1787387959.059872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387959.059977:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690885504 00000100:00100000:2.0:1787387959.059987:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690885504 00000100:00100000:2.0:1787387959.060046:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:2.0:1787387959.060057:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+10:13845:x1874211690885504:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787387959.060075:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387959.060094:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f90000/0x93d41aeaa23c8a25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52c62 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.060126:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f90000/0x93d41aeaa23c8a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c62 expref: 11 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.060137:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f90000/0x93d41aeaa23c8a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c62 expref: 11 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.060146:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90000, rc 0) 00000100:00100000:2.0:1787387959.060345:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:13845:x1874211690885504:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 288us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387959.060353:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:2.0:1787387959.064484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387959.064573:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690885632 00000100:00100000:3.0:1787387959.064583:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690885632 00000100:00100000:3.0:1787387959.064652:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:3.0:1787387959.064681:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:13845:x1874211690885632:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787387959.065121:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:13845:x1874211690885632:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 442us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387959.065129:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:0.0:1787387959.069661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387959.069871:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690885760 00000100:00100000:2.0:1787387959.069897:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690885760 00000100:00100000:2.0:1787387959.069953:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:2.0:1787387959.069963:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:13845:x1874211690885760:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787387959.070348:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:13845:x1874211690885760:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 385us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387959.070356:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:0.0:1787387959.075935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387959.076824:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690885888 00000100:00100000:3.0:1787387959.076837:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690885888 00000100:00100000:3.0:1787387959.076899:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:3.0:1787387959.076909:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:13852:x1874211690885888:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787387959.081010:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:13852:x1874211690885888:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 4090us (5072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387959.081026:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:1.0:1787387959.115702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387959.115873:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690886016 00000100:00100000:0.0:1787387959.115884:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690886016 00000100:00100000:0.0:1787387959.115941:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:0.0:1787387959.115951:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:13852:x1874211690886016:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787387959.117666:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:13852:x1874211690886016:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 1705us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387959.117680:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:0.0:1787387959.135816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387959.135979:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690886144 00000100:00100000:3.0:1787387959.135990:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690886144 00000100:00100000:3.0:1787387959.136050:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:3.0:1787387959.136060:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:13845:x1874211690886144:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787387959.136077:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387959.136588:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d437460a400/0x93d41aeaa23c8a2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52c8c expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387959.136622:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d437460a400/0x93d41aeaa23c8a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c8c expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387959.136633:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d437460a400/0x93d41aeaa23c8a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c8c expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387959.136643:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a400, rc 0) 00000100:00100000:3.0:1787387959.136733:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:13845:x1874211690886144:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 675us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387959.136792:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:2.0:1787387959.142956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387959.143082:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690886272 00000100:00100000:0.0:1787387959.143096:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690886272 00000100:00100000:0.0:1787387959.143153:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:0.0:1787387959.143164:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:13845:x1874211690886272:12345-192.168.204.59@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787387959.143263:0:14239:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787387959.143290:0:14239:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787387959.143299:0:14239:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787387959.143302:0:14239:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787387959.143305:0:14239:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787387959.145796:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:13845:x1874211690886272:12345-192.168.204.59@tcp:256:mount.lustre.0 Request processed in 2623us (2848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387959.145811:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:1.0:1787387959.149850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387959.149936:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690886400 00000100:00100000:2.0:1787387959.150072:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690886400 00000100:00100000:2.0:1787387959.150546:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:2.0:1787387959.150557:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:13845:x1874211690886400:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787387959.150576:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387959.150598:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c8a33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52c93 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.150627:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c8a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c93 expref: 13 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.150637:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c8a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c93 expref: 13 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.150647:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91a00, rc 0) 00000100:00100000:2.0:1787387959.150709:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13845:x1874211690886400:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 154us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387959.150716:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:2.0:1787387959.152830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387959.152915:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690886528 00000100:00100000:0.0:1787387959.152926:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690886528 00000100:00100000:0.0:1787387959.153454:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:0.0:1787387959.153465:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13845:x1874211690886528:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787387959.153827:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13845:x1874211690886528:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 363us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387959.153836:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:1.0:1787387959.157343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387959.157730:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690886656 00000100:00100000:3.0:1787387959.157830:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690886656 00000100:00100000:3.0:1787387959.157926:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:3.0:1787387959.157937:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437201b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13845:x1874211690886656:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787387959.158324:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437201b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13845:x1874211690886656:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 388us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387959.158333:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:1.0:1787387959.163817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387959.163907:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690886784 00000100:00100000:0.0:1787387959.163918:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690886784 00000100:00100000:0.0:1787387959.163986:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:0.0:1787387959.163995:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13857:x1874211690886784:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787387959.164304:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13857:x1874211690886784:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 308us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387959.164313:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:0.0:1787387959.170379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387959.170537:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690886912 00000100:00100000:3.0:1787387959.170548:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690886912 00000100:00100000:3.0:1787387959.170633:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:3.0:1787387959.170652:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13857:x1874211690886912:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787387959.171146:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13857:x1874211690886912:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 494us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387959.171161:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:1.0:1787387959.183074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387959.183662:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690887040 00000100:00100000:3.0:1787387959.183675:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690887040 00000100:00100000:3.0:1787387959.183725:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1787387959.183734:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1874211690887040:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787387959.183812:0:14246:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e21cb2fe-2288-41c3-ab30-f8ea608ab52c@192.168.204.59@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:3.0:1787387959.183856:0:14246:0:(genops.c:1406:class_connect()) connect: client e21cb2fe-2288-41c3-ab30-f8ea608ab52c, cookie 0x93d41aeaa23c8a3a 00000004:00100000:3.0:1787387959.183890:0:14246:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1787387959.184028:0:14246:0:(import.c:65:import_set_state_nolock()) ffff8d4358466000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787387959.184098:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:2349:x1874211690887040:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 363us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387959.184105:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1787387959.191113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387959.191153:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387959.191305:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690887168 00000100:00100000:3.0:1787387959.191315:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690887168 00000100:00100000:3.0:1787387959.191394:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690887296 00000100:00100000:3.0:1787387959.191397:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690887296 00000100:00100000:3.0:1787387959.191412:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:3.0:1787387959.191420:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+7:0:x1874211690887168:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787387959.191459:0:14247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787387959.191518:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+7:0:x1874211690887168:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 98us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387959.191526:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:3.0:1787387959.191544:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:3.0:1787387959.191550:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:13845:x1874211690887296:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787387959.191560:0:14247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787387959.191579:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:13845:x1874211690887296:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 30us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387959.191585:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00080000:1.0:1787387959.191762:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387959.197425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387959.197684:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690887424 00000100:00100000:3.0:1787387959.197695:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690887424 00000100:00100000:3.0:1787387959.197798:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1787387959.197809:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:13845:x1874211690887424:12345-192.168.204.59@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787387959.197894:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:13845:x1874211690887424:12345-192.168.204.59@tcp:40:mount.lustre.0 Request processed in 87us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387959.197902:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:1.0:1787387959.204551:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387959.204592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387959.204712:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690887808 00000100:00100000:3.0:1787387959.204723:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690887808 00000100:00100000:3.0:1787387959.204815:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:3.0:1787387959.204838:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:13845:x1874211690887808:12345-192.168.204.59@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787387959.205088:0:14249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787387959.205242:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:13845:x1874211690887808:12345-192.168.204.59@tcp:33:mount.lustre.0 Request processed in 405us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387959.205251:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:1.0:1787387959.206119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387959.212370:0:15604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690887552 00000100:00100000:2.0:1787387959.212387:0:15604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690887552 00000100:00100000:1.0:1787387959.212615:0:15604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690887680 00000100:00100000:1.0:1787387959.212620:0:15604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690887680 00000100:00100000:1.0:1787387959.212658:0:15604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:1.0:1787387959.212666:0:15604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1874211690887552:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787387959.212699:0:15604:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e21cb2fe-2288-41c3-ab30-f8ea608ab52c@192.168.204.59@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:1.0:1787387959.212768:0:15604:0:(genops.c:1406:class_connect()) connect: client e21cb2fe-2288-41c3-ab30-f8ea608ab52c, cookie 0x93d41aeaa23c8a41 00002000:00100000:1.0:1787387959.212781:0:15604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e21cb2fe-2288-41c3-ab30-f8ea608ab52c/ffff8d42411a3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787387959.212792:0:15604:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787387959.212902:0:15604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787387959.213158:0:15604:0:(import.c:65:import_set_state_nolock()) ffff8d42411a7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387959.213248:0:15604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:2349:x1874211690887552:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 581us (8654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387959.213255:0:15604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:1.0:1787387959.213275:0:15604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1787387959.213280:0:15604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1874211690887680:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787387959.213295:0:15604:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e21cb2fe-2288-41c3-ab30-f8ea608ab52c@192.168.204.59@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:1.0:1787387959.213324:0:15604:0:(genops.c:1406:class_connect()) connect: client e21cb2fe-2288-41c3-ab30-f8ea608ab52c, cookie 0x93d41aeaa23c8a48 00002000:00100000:1.0:1787387959.213329:0:15604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e21cb2fe-2288-41c3-ab30-f8ea608ab52c/ffff8d42411a0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787387959.213335:0:15604:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787387959.213507:0:15604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787387959.213522:0:15604:0:(import.c:65:import_set_state_nolock()) ffff8d42411a2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387959.213544:0:15604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:2349:x1874211690887680:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 263us (7429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387959.213551:0:15604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1787387959.351051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387959.351154:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690887936 00000100:00100000:2.0:1787387959.351164:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690887936 00000100:00100000:2.0:1787387959.351440:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:2.0:1787387959.351452:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:13878:x1874211690887936:12345-192.168.204.59@tcp:101:mkdir.0 00010000:00010000:2.0:1787387959.351472:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387959.351495:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8a4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52cbd expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.351567:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.351581:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.351593:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387959.351877:0:14246:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787387959.351882:0:14246:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787387959.351969:0:14246:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.351999:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8a4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cbd expref: 8 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.352018:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cbd expref: 7 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387959.352034:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720600) 00010000:00010000:2.0:1787387959.352038:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787387959.352042:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91200, rc 0) 00000100:00100000:2.0:1787387959.352114:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+7:13878:x1874211690887936:12345-192.168.204.59@tcp:101:mkdir.0 Request processed in 664us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387959.352122:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00010000:00010000:3.0:1787387959.774489:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787387960.501845:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e21cb2fe-2288-41c3-ab30-f8ea608ab52c 00000001:00100000:1.0:1787387960.501860:0:6629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 396e9ca3-e412-469b-a169-aad215faf0ba 00010000:00010000:2.0:1787387960.800850:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387961.822139:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787387962.002951:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 396e9ca3-e412-469b-a169-aad215faf0ba 00000001:00100000:0.0:1787387962.002972:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e21cb2fe-2288-41c3-ab30-f8ea608ab52c 00000001:02000400:3.0:1787387962.438706:0:16113:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787387962.847246:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787387963.024223:0:7514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e21cb2fe-2288-41c3-ab30-f8ea608ab52c 00010000:00010000:3.0:1787387963.872176:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387963.997918:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387963.998567:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709753472:0@lo:400:kworker.0 00000100:00100000:3.0:1787387963.998708:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709753344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387963.998834:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387963.998901:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709753728:0@lo:400:kworker.0 00000100:00100000:3.0:1787387963.998928:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387963.998952:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387963.998957:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709753856:0@lo:400:kworker.0 00000100:00100000:3.0:1787387963.999000:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387963.999038:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709753344 00000100:00100000:3.0:1787387963.999048:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709753344 00000100:00100000:3.0:1787387963.999121:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387963.999134:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709753344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787387963.999189:0:14884:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387963.999246:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709753344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387963.999255:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387963.999283:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709753856 00000100:00100000:3.0:1787387963.999286:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709753856 00000100:00100000:3.0:1787387963.999330:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787387963.999336:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709753856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387963.999481:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387963.999516:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709753984:0@lo:400:kworker.0 00000100:00100000:0.0:1787387963.999546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387963.999570:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787387963.999709:0:15604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709753728 00000100:00100000:1.0:1787387963.999714:0:15604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709753728 00000100:00100000:1.0:1787387963.999766:0:15604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387963.999814:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709753600:0@lo:400:kworker.0 00000100:00100000:0.0:1787387963.999849:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387963.999870:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709754112:0@lo:400:kworker.0 00000100:00100000:0.0:1787387963.999898:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387963.999933:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709753472 00000100:00100000:0.0:1787387963.999937:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709753472 00000100:00100000:0.0:1787387963.999973:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787387963.999980:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3311:x1874211709753472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387964.000025:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3311:x1874211709753472:12345-0@lo:400:kworker.0 Request processed in 45us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.000033:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787387964.000071:0:14246:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787387964.000080:0:14246:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787387964.000100:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709753600 00000100:00100000:0.0:1787387964.000104:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709753600 00000100:00100000:0.0:1787387964.000132:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387964.000139:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709753600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387964.000170:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874211709753600:12345-0@lo:400:kworker.0 Request processed in 33us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387964.000177:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387964.000523:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387964.000527:0:15604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709753728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387964.000537:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709754240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387964.000587:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.000600:0:15604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709753728:12345-0@lo:400:kworker.0 Request processed in 826us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.000608:0:15604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787387964.000942:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709754240 00000100:00100000:2.0:1787387964.000949:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709754240 00000100:00100000:2.0:1787387964.000981:0:14883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387964.000988:0:14883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709754240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387964.001027:0:14883:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787387964.001075:0:14883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709754240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.001083:0:14883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787387964.001105:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387964.001111:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387964.001154:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709754240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387964.001208:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709753728:0@lo:400:kworker.0 00000100:00100000:2.0:1787387964.001226:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709753344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387964.003804:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709753856:12345-0@lo:400:kworker.0 Request processed in 4451us (4786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.003823:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787387964.003865:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709753984 00000100:00100000:3.0:1787387964.003875:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709753984 00000100:00100000:3.0:1787387964.003936:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709754112 00000100:00100000:3.0:1787387964.003940:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709754112 00000100:00100000:3.0:1787387964.003957:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787387964.003966:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709753984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387964.004011:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874211709753984:12345-0@lo:400:kworker.0 Request processed in 46us (4465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.004017:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787387964.004029:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787387964.004035:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709754112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387964.004065:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874211709754112:12345-0@lo:400:kworker.0 Request processed in 29us (4166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.004070:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787387964.004107:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387964.004260:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874211709753600:0@lo:400:kworker.0 00000100:00100000:0.0:1787387964.004278:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874211709754112:0@lo:400:kworker.0 00000100:00100000:0.0:1787387964.004305:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709753472:0@lo:400:kworker.0 00000100:00100000:0.0:1787387964.004319:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874211709753984:0@lo:400:kworker.0 00000100:00100000:2.0:1787387964.006274:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709753856:0@lo:400:kworker.0 00000040:00080000:1.0:1787387964.138638:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787387964.330129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387964.330178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387964.330198:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387964.330232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387964.330255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387964.330357:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690888448 00000100:00100000:0.0:1787387964.330370:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690888448 00000100:00100000:1.0:1787387964.330393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387964.330420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387964.330437:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690888704 00000100:00100000:0.0:1787387964.330440:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690888704 00000100:00100000:1.0:1787387964.330443:0:15604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690888320 00000100:00100000:0.0:1787387964.330458:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690888832 00000100:00100000:0.0:1787387964.330461:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690888832 00000100:00100000:1.0:1787387964.330463:0:15604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690888320 00000100:00100000:0.0:1787387964.330479:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:0.0:1787387964.330496:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:396e9ca3-e412-469b-a169-aad215faf0ba+5:2351:x1874211690888448:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387964.330602:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:396e9ca3-e412-469b-a169-aad215faf0ba+5:2351:x1874211690888448:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 108us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.330644:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690888064 00000100:00100000:2.0:1787387964.330649:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690888064 00000100:00100000:2.0:1787387964.330687:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:2.0:1787387964.330695:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:2351:x1874211690888064:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387964.330725:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:2351:x1874211690888064:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 32us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.330733:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:3.0:1787387964.332103:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690888192 00000100:00100000:3.0:1787387964.332121:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690888192 00000100:00100000:3.0:1787387964.332199:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690888576 00000100:00100000:3.0:1787387964.332203:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690888576 00000100:00100000:3.0:1787387964.332238:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:3.0:1787387964.332248:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+6:2351:x1874211690888192:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387964.332347:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+6:2351:x1874211690888192:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 100us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.332375:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:3.0:1787387964.332397:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1787387964.332403:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:2351:x1874211690888576:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387964.332431:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:2351:x1874211690888576:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.332438:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:1.0:1787387964.335830:0:15604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1787387964.335859:0:15604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2351:x1874211690888704:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387964.336788:0:15604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2351:x1874211690888704:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 132us (5776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.336811:0:15604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1787387964.336850:0:15604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:1.0:1787387964.336866:0:15604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2351:x1874211690888832:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387964.336931:0:15604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2351:x1874211690888832:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 71us (6509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.336938:0:15604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:1.0:1787387964.336950:0:15604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1787387964.336958:0:15604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:396e9ca3-e412-469b-a169-aad215faf0ba+5:2351:x1874211690888320:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387964.337019:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1787387964.337435:0:15604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:396e9ca3-e412-469b-a169-aad215faf0ba+5:2351:x1874211690888320:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 476us (7176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.337444:0:15604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00080000:3.0:1787387964.337764:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387964.337772:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387964.337775:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787387964.896965:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387965.919544:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787387966.042098:0:16262:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff5afa9100 00000020:00000080:1.0:1787387966.042121:0:16262:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787387966.042127:0:16262:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787387966.042138:0:16262:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5afab390 20000000:00000080:1.0:1787387966.042147:0:16262:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d4242b13000 uarg=0000000000000000 20000000:01000000:1.0:1787387966.042205:0:16262:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787387966.042212:0:16262:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787387966.042218:0:16262:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787387966.043549:0:16263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787387966.044040:0:16262:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787387966.053152:0:16262:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787387966.053459:0:16262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.053486:0:16262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d43413fce00/0x93d41aeaa23c8754 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c874d expref: 18 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.053495:0:16262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c87a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c879a expref: 18 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.053513:0:16262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c8811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c880a expref: 18 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.053526:0:16262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4242f90400/0x93d41aeaa23c89fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c31 expref: 12 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.053534:0:16262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c8a33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c93 expref: 12 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.053542:0:16262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.053611:0:16262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c8a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c93 expref: 12 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.053632:0:16262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c8a33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c93 expref: 12 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387966.053652:0:16262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345d05f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16262:1874211709754368:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387966.056363:0:16262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4242f90400/0x93d41aeaa23c89fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c31 expref: 12 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.056388:0:16262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4242f90400/0x93d41aeaa23c89fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c31 expref: 12 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387966.056408:0:16262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16262:1874211709754496:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387966.056516:0:16262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c8811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c880a expref: 18 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.056525:0:16262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c8811 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c880a expref: 18 pid: 14239 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387966.056534:0:16262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16262:1874211709754624:0@lo:104: 00000100:00100000:2.0:1787387966.056584:0:16262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787387966.056650:0:16262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c87a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c879a expref: 18 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.056678:0:16262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c87a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c879a expref: 18 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387966.056687:0:16262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16262:1874211709754752:0@lo:104: 00000100:00100000:2.0:1787387966.056724:0:16262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787387966.056783:0:16262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d43413fce00/0x93d41aeaa23c8754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x93d41aeaa23c874d expref: 18 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.056792:0:16262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d43413fce00/0x93d41aeaa23c8754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x93d41aeaa23c874d expref: 18 pid: 14238 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387966.056800:0:16262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab45c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16262:1874211709754880:0@lo:104: 00000100:00100000:2.0:1787387966.056845:0:16262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387966.056857:0:16262:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4349b4f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.057449:0:14228:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787387966.057471:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709754624 00000100:00100000:3.0:1787387966.057481:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709754624 00000100:00100000:1.0:1787387966.057990:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387966.058367:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690888960 00000100:00100000:0.0:1787387966.058374:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690888960 00010000:00010000:0.0:1787387966.058406:0:14230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c8a33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c93 expref: 13 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387966.058452:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:0.0:1787387966.058463:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:2350:x1874211690888960:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387966.058477:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387966.058483:0:14230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c8a33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c93 expref: 13 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.058496:0:14230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c8a33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c93 expref: 13 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387966.058693:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709754752 00000100:00100000:3.0:1787387966.058698:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709754752 00000100:00100000:3.0:1787387966.058716:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709754880 00000100:00100000:3.0:1787387966.058719:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709754880 00000100:00100000:3.0:1787387966.058733:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387966.058764:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+5:16262:x1874211709754624:12345-0@lo:104: 00010000:00010000:3.0:1787387966.058780:0:14228:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.058859:0:14228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387966.058866:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+5:16262:x1874211709754624:12345-0@lo:104: Request processed in 104us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.058874:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387966.058912:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387966.058918:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a749c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+4:16262:x1874211709754752:12345-0@lo:104: 00010000:00010000:3.0:1787387966.058927:0:14228:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.058965:0:14228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787387966.058970:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a749c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+4:16262:x1874211709754752:12345-0@lo:104: Request processed in 53us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.058976:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387966.058988:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787387966.058994:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d435c7e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+3:16262:x1874211709754880:12345-0@lo:104: 00010000:00010000:3.0:1787387966.059001:0:14228:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.059029:0:14228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787387966.059034:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d435c7e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+3:16262:x1874211709754880:12345-0@lo:104: Request processed in 41us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.059040:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787387966.059110:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787387966.059117:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.059125:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d43413fc600 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:3.0:1787387966.059130:0:14233:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.059140:0:14233:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387966.059158:0:14233:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387966.059165:0:14233:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787387966.059206:0:14233:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.059214:0:14233:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387966.059252:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.059260:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d43413fc600/0x93d41aeaa23c880a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8811 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.059278:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787387966.059282:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.059288:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d434152e000 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:3.0:1787387966.059292:0:14233:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.059438:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787387966.059724:0:16262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f91a00/0x93d41aeaa23c8a33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c93 expref: 13 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387966.059763:0:16262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345d05f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16262:1874211709754368:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387966.059780:0:16262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16262:1874211709754624:0@lo:104: 00000100:00100000:2.0:1787387966.059791:0:16262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16262:1874211709754752:0@lo:104: 00000100:00100000:0.0:1787387966.059803:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:2350:x1874211690888960:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1339us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387966.059805:0:16262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab45c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16262:1874211709754880:0@lo:104: 00000100:00100000:0.0:1787387966.059820:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00010000:00010000:2.0:1787387966.060880:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387966.061443:0:14233:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387966.061456:0:14233:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387966.061462:0:14233:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787387966.061528:0:14233:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.061535:0:14233:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387966.061562:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.061570:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d434152e000/0x93d41aeaa23c879a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c87a1 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.061583:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387966.061585:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387966.061587:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387966.061619:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3314:1874211709755008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387966.061701:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387966.061793:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709755136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387966.061881:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387966.061917:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709755008 00000100:00100000:3.0:1787387966.061925:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709755008 00010000:00010000:3.0:1787387966.061959:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c8811 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c880a expref: 19 pid: 14239 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387966.061987:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709755136 00000100:00100000:3.0:1787387966.061989:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709755136 00010000:00010000:3.0:1787387966.061998:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c87a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c879a expref: 20 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387966.062011:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387966.062019:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+20:3314:x1874211709755008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787387966.062034:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387966.062046:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c8811 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c880a expref: 20 pid: 14239 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.062058:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c8811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c880a expref: 20 pid: 14239 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.062074:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d434152ec00/0x93d41aeaa23c8811 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c880a expref: 20 pid: 14239 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.062088:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387966.062119:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3314:x1874211709755008:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.062126:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387966.062144:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787387966.062150:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437408cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:3311:x1874211709755136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787387966.062157:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387966.062162:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c87a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c879a expref: 18 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.062170:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c87a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c879a expref: 18 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.062179:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43413fd200/0x93d41aeaa23c87a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c879a expref: 18 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.062188:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387966.062207:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437408cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:3311:x1874211709755136:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.062213:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787387966.062281:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3314:1874211709755008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387966.062313:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3311:1874211709755136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787387966.062634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387966.062706:0:16262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16262:1874211709754496:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387966.062775:0:16262:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387966.062860:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690889088 00000100:00100000:3.0:1787387966.062865:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690889088 00010000:00010000:3.0:1787387966.062884:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4242f90400/0x93d41aeaa23c89fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c31 expref: 12 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387966.062910:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1787387966.062917:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:2350:x1874211690889088:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387966.062925:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387966.062929:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4242f90400/0x93d41aeaa23c89fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c31 expref: 12 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.062940:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4242f90400/0x93d41aeaa23c89fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c31 expref: 12 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.062954:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4242f90400/0x93d41aeaa23c89fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c31 expref: 12 pid: 14237 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.062964:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387966.063066:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:2350:x1874211690889088:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 148us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.063073:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00010000:00010000:1.0:1787387966.063352:0:16265:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387966.063355:0:16265:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387966.063366:0:16265:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387966.063399:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063409:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460bc00 already unused, calling callback (ffffffffc1b81c20) 10000000:00010000:3.0:1787387966.063414:0:14234:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063434:0:14234:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387966.063442:0:14234:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387966.063449:0:14234:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787387966.063490:0:14234:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063498:0:14234:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387966.063519:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063526:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff8d437460bc00/0x93d41aeaa23c874d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x93d41aeaa23c8754 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063541:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387966.063542:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387966.063544:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387966.063557:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3312:1874211709755264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387966.063600:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387966.063659:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709755264 00000100:00100000:3.0:1787387966.063663:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709755264 00010000:00010000:3.0:1787387966.063678:0:14230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d43413fce00/0x93d41aeaa23c8754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c874d expref: 17 pid: 14238 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387966.063698:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387966.063704:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:3312:x1874211709755264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787387966.063718:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387966.063723:0:14230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d43413fce00/0x93d41aeaa23c8754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x93d41aeaa23c874d expref: 17 pid: 14238 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063733:0:14230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d43413fce00/0x93d41aeaa23c8754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x93d41aeaa23c874d expref: 17 pid: 14238 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063765:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d43413fce00/0x93d41aeaa23c8754 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x93d41aeaa23c874d expref: 17 pid: 14238 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063779:0:14230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063788:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063803:0:14230:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063811:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063819:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063825:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063830:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030800 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387966.063835:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063852:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063866:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.063874:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387966.063899:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:3312:x1874211709755264:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.063905:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387966.063934:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3312:1874211709755264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387966.064207:0:16262:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.064218:0:16262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.064225:0:16262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4340030800/0x93d41aeaa23c8a5d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.944525:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387967.402860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387967.402947:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690889216 00000100:00100000:3.0:1787387967.402957:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690889216 00000100:00100000:3.0:1787387967.403018:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:3.0:1787387967.403041:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+11:13731:x1874211690889216:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387967.403058:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387967.403077:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d437460a200/0x93d41aeaa23c8a64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52cc4 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.403104:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d437460a200/0x93d41aeaa23c8a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cc4 expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.403114:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d437460a200/0x93d41aeaa23c8a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cc4 expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.403123:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460a200, rc 0) 00000100:00100000:3.0:1787387967.403180:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:13731:x1874211690889216:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 143us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387967.403195:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:0.0:1787387967.405456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387967.405534:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690889344 00000100:00100000:2.0:1787387967.405543:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690889344 00000100:00100000:2.0:1787387967.405601:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00100000:2.0:1787387967.405611:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:13731:x1874211690889344:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387967.405936:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:13731:x1874211690889344:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 325us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387967.405944:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00100000:3.0:1787387967.407710:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387967.407856:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690889472 00000100:00100000:0.0:1787387967.407864:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690889472 00000100:00100000:0.0:1787387967.407915:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:0.0:1787387967.407924:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:13731:x1874211690889472:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387967.408153:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:13731:x1874211690889472:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 229us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387967.408161:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:1.0:1787387967.423346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387967.423786:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690889600 00000100:00100000:3.0:1787387967.423796:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690889600 00000100:00100000:3.0:1787387967.423850:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:3.0:1787387967.423861:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+12:13731:x1874211690889600:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387967.423878:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387967.423896:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c8a6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52ccb expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.423923:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c8a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ccb expref: 13 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.423935:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d437460bc00/0x93d41aeaa23c8a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ccb expref: 13 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.423945:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460bc00, rc 0) 00000100:00100000:3.0:1787387967.424010:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13731:x1874211690889600:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 150us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387967.424017:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:3.0:1787387967.428255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387967.430082:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690889728 00000100:00100000:2.0:1787387967.430095:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690889728 00000100:00100000:0.0:1787387967.431700:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:0.0:1787387967.431720:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13731:x1874211690889728:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387967.432010:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13731:x1874211690889728:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 292us (3763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387967.432027:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:3.0:1787387967.438526:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387967.443197:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690889856 00000100:00100000:0.0:1787387967.443214:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690889856 00000100:00100000:0.0:1787387967.443285:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:0.0:1787387967.443297:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13731:x1874211690889856:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387967.443570:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:13731:x1874211690889856:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 275us (5052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387967.443590:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 110 00010000:00010000:1.0:1787387967.967456:0:16265:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787387967.967579:0:14243:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787387967.967583:0:14243:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d43746ce000 from 10 10000000:01000000:3.0:1787387967.967589:0:14243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787387967.967631:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460a000/0x93d41aeaa23c8a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.967656:0:14243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d437460a000/0x93d41aeaa23c8a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.967667:0:14243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d437460a000/0x93d41aeaa23c8a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387967.967691:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709755392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787387967.967783:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387967.967834:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351228540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387967.967906:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709755392 00000100:00100000:0.0:1787387967.967914:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709755392 00000100:00100000:0.0:1787387967.967961:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787387967.967969:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+16:14243:x1874211709755392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387967.967982:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387967.967993:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4377c71400/0x93d41aeaa23c8a79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c8a72 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387967.968026:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4377c71400/0x93d41aeaa23c8a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c8a72 expref: 17 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387967.968038:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4377c71400/0x93d41aeaa23c8a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8a72 expref: 17 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387967.968047:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71400, rc 0) 00000100:00100000:0.0:1787387967.968088:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:14243:x1874211709755392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387967.968101:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787387967.968244:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709755392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387967.968258:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d437460a000/0x93d41aeaa23c8a72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8a79 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.968267:0:14243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d437460a000/0x93d41aeaa23c8a72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c8a79 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387967.968316:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709755520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387967.968338:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387967.968363:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351228540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387967.969132:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709755520 00000100:00100000:0.0:1787387967.969139:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709755520 00000100:00100000:0.0:1787387967.969182:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787387967.969190:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:14243:x1874211709755520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387967.969433:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:14243:x1874211709755520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387967.969440:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787387967.969582:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709755520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387967.969621:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709755648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387967.969660:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387967.969689:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4351228540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387967.969735:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709755648 00000100:00100000:0.0:1787387967.969761:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709755648 00000100:00100000:0.0:1787387967.969782:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787387967.969787:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:14243:x1874211709755648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387967.971138:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:14243:x1874211709755648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1343us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387967.971149:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787387967.972001:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709755648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787387967.989970:0:16345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787387967.990471:0:14243:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787387967.990505:0:14243:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787387967.990516:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460a000/0x93d41aeaa23c8a72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8a79 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.990528:0:14243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d437460a000/0x93d41aeaa23c8a72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8a79 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387967.990538:0:14243:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787387967.990541:0:14243:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4342bed800 from 10 10000000:01000000:3.0:1787387967.990543:0:14243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787387967.990587:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460a600/0x93d41aeaa23c8a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.990596:0:14243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d437460a600/0x93d41aeaa23c8a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387967.990607:0:14243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d437460a600/0x93d41aeaa23c8a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387967.990634:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709755776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787387967.990702:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387967.990772:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4358a8f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387967.991124:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709755776 00000100:00100000:1.0:1787387967.991132:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709755776 00000100:00100000:1.0:1787387967.991179:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787387967.991187:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+17:14243:x1874211709755776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387967.991200:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387967.991212:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4340031600/0x93d41aeaa23c8a87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c8a80 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387967.991233:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4340031600/0x93d41aeaa23c8a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c8a80 expref: 18 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387967.991243:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4340031600/0x93d41aeaa23c8a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8a80 expref: 18 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387967.991251:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340031600, rc 0) 00000100:00100000:1.0:1787387967.991290:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:14243:x1874211709755776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387967.991296:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787387967.991335:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709755776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387967.991348:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d437460a600/0x93d41aeaa23c8a80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8a87 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387967.991358:0:14243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d437460a600/0x93d41aeaa23c8a80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c8a87 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387967.991423:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709755904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387967.991450:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387967.991466:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4349b4f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387967.991479:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709755904 00000100:00100000:1.0:1787387967.991482:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709755904 00000100:00100000:1.0:1787387967.991503:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787387967.991508:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:14243:x1874211709755904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387967.991757:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:14243:x1874211709755904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387967.991764:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787387967.991792:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709755904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387967.991817:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709756032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387967.991857:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387967.991869:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4349b4f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387967.991880:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709756032 00000100:00100000:1.0:1787387967.991883:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709756032 00000100:00100000:1.0:1787387967.991917:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787387967.991923:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:14243:x1874211709756032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387967.994333:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:14243:x1874211709756032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2400us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387967.994348:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787387968.001730:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709756032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787387968.010701:0:16349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787387968.011110:0:14243:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787387968.011131:0:14243:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387968.011142:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d437460a600/0x93d41aeaa23c8a80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8a87 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387968.011155:0:14243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d437460a600/0x93d41aeaa23c8a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8a87 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387968.011166:0:14243:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787387968.011168:0:14243:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d437a1bb000 from 10 10000000:01000000:2.0:1787387968.011171:0:14243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387968.011210:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90600/0x93d41aeaa23c8a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387968.011218:0:14243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff8d4242f90600/0x93d41aeaa23c8a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387968.011229:0:14243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff8d4242f90600/0x93d41aeaa23c8a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387968.011255:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709756160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387968.011322:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387968.011361:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43437b46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387968.011383:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709756160 00000100:00100000:2.0:1787387968.011399:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709756160 00000100:00100000:2.0:1787387968.011443:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787387968.011453:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d434a3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+18:14243:x1874211709756160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387968.011467:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387968.011480:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4242f90a00/0x93d41aeaa23c8a95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d41aeaa23c8a8e expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387968.011505:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4242f90a00/0x93d41aeaa23c8a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x93d41aeaa23c8a8e expref: 19 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387968.011515:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4242f90a00/0x93d41aeaa23c8a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x93d41aeaa23c8a8e expref: 19 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387968.011525:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90a00, rc 0) 00000100:00100000:2.0:1787387968.011574:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d434a3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:14243:x1874211709756160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387968.011581:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787387968.011631:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709756160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387968.011645:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff8d4242f90600/0x93d41aeaa23c8a8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8a95 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387968.011653:0:14243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff8d4242f90600/0x93d41aeaa23c8a8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x93d41aeaa23c8a95 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387968.011699:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709756288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387968.011727:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387968.011769:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d43437b46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387968.011792:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709756288 00000100:00100000:2.0:1787387968.011804:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709756288 00000100:00100000:2.0:1787387968.011827:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787387968.011832:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:14243:x1874211709756288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387968.013043:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:14243:x1874211709756288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1205us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387968.013054:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787387968.013299:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709756288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387968.013351:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4345d06a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709756416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387968.013392:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387968.013462:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387968.014008:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709756416 00000100:00100000:2.0:1787387968.014079:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709756416 00000100:00100000:2.0:1787387968.014153:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787387968.014162:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:14243:x1874211709756416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387968.014397:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:14243:x1874211709756416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387968.014404:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787387968.018355:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4345d06a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:14243:1874211709756416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787387968.019917:0:16351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787387968.020154:0:14243:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787387968.020180:0:14243:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787387968.020192:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff8d4242f90600/0x93d41aeaa23c8a8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8a95 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387968.020203:0:14243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff8d4242f90600/0x93d41aeaa23c8a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x93d41aeaa23c8a95 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387968.990109:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387969.117972:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387969.118007:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709756544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387969.118082:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387969.118147:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709756672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387969.118173:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387969.118360:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709757056:0@lo:400:kworker.0 00000100:00100000:0.0:1787387969.118393:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387969.118411:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387969.118416:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4372013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709757184:0@lo:400:kworker.0 00000100:00100000:0.0:1787387969.118437:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387969.118466:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709757056 00000100:00100000:0.0:1787387969.118486:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709757056 00000100:00100000:1.0:1787387969.119575:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709756928:0@lo:400:kworker.0 00000100:00100000:1.0:1787387969.119625:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387969.119650:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787387969.119657:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3312:1874211709756800:0@lo:400:kworker.0 00000100:00100000:1.0:1787387969.119685:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387969.119712:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4372011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709757312:0@lo:400:kworker.0 00000100:00100000:1.0:1787387969.119755:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387969.119880:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709756928 00000100:00100000:1.0:1787387969.119887:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709756928 00000100:00100000:1.0:1787387969.119939:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387969.119962:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709756928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387969.120021:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709756928:12345-0@lo:400:kworker.0 Request processed in 61us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387969.120029:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387969.120072:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709756928:0@lo:400:kworker.0 00000100:00100000:1.0:1787387969.120113:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709757184 00000100:00100000:1.0:1787387969.120117:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709757184 00000100:00100000:0.0:1787387969.120187:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709757312 00000100:00100000:0.0:1787387969.120196:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709757312 00000100:00100000:1.0:1787387969.120878:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787387969.120889:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709757056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387969.120942:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874211709757056:12345-0@lo:400:kworker.0 Request processed in 56us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387969.120948:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787387969.120961:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787387969.120967:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709757184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387969.120993:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709757184:12345-0@lo:400:kworker.0 Request processed in 26us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387969.120998:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787387969.121046:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4372013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709757184:0@lo:400:kworker.0 00000100:00100000:1.0:1787387969.121059:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874211709757056:0@lo:400:kworker.0 00000100:00080000:1.0:1787387969.121096:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787387969.121100:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787387969.121125:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709756800 00000100:00100000:1.0:1787387969.121129:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709756800 00000100:00100000:3.0:1787387969.121137:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709756544 00000100:00100000:3.0:1787387969.121145:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709756544 00000100:00100000:1.0:1787387969.121162:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787387969.121172:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3312:x1874211709756800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387969.121225:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3312:x1874211709756800:12345-0@lo:400:kworker.0 Request processed in 55us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387969.121231:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787387969.121270:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709756672 00000100:00100000:1.0:1787387969.121273:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3312:1874211709756800:0@lo:400:kworker.0 00000100:00100000:3.0:1787387969.121276:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709756672 00000100:00100000:3.0:1787387969.121300:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787387969.121300:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387969.121779:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709756544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787387969.121815:0:14884:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387969.121858:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709756544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387969.121957:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709756544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387969.122116:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787387969.122135:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787387969.122142:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709756672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787387969.122162:0:14884:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387969.122285:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874211709756672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (4110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387969.122292:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787387969.123306:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874211709756672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387969.123677:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787387969.123690:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709757312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387969.123769:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874211709757312:12345-0@lo:400:kworker.0 Request processed in 85us (4032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387969.123776:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787387969.123842:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4372011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874211709757312:0@lo:400:kworker.0 00000100:00100000:1.0:1787387969.381620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387969.383899:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690889984 00000100:00100000:2.0:1787387969.383915:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690889984 00000100:00100000:2.0:1787387969.384097:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:2.0:1787387969.384107:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+6:14388:x1874211690889984:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787387969.384128:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387969.384150:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8a9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52cd2 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.384226:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8aa3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.384241:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.384275:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.384297:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8aaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.384305:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8aaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.384313:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8aaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.385243:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91c00/0x93d41aeaa23c8ab1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.385261:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91c00/0x93d41aeaa23c8ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.385270:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91c00/0x93d41aeaa23c8ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387969.385361:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787387969.385366:0:14245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000100:00080000:1.0:1787387969.386053:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1787387969.386656:0:14245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91c00/0x93d41aeaa23c8ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.386674:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.386944:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8aa3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.386967:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.386974:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387969.386979:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.386987:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8aa3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387003:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720600) 00010000:00010000:2.0:1787387969.387006:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387969.387010:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8aa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387016:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91400/0x93d41aeaa23c8aa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387031:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8aaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387038:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8aaa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387043:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8aaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387049:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387969.387052:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8aaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387067:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8aaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387080:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d436f2f6e00) 00010000:00010000:2.0:1787387969.387083:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387969.387087:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8aaa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387092:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8aaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387210:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8a9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cd2 expref: 8 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387226:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91c00/0x93d41aeaa23c8ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cd2 expref: 7 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.387234:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d436f2f6400) 00010000:00010000:2.0:1787387969.387236:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787387969.387239:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91c00, rc 0) 00000100:00100000:2.0:1787387969.388050:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+7:14388:x1874211690889984:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 3939us (6435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387969.388061:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:2.0:1787387969.395054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387969.395178:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690890240 00000100:00100000:1.0:1787387969.395188:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690890240 00000100:00100000:1.0:1787387969.395255:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:1.0:1787387969.395265:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+7:14388:x1874211690890240:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787387969.395287:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387969.395311:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8ab8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52cd9 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.395403:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8abf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.395417:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8abf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.395429:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8abf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.395516:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ac6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.395550:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.395558:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.398818:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c8acd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.398912:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c8acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.398926:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c8acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387969.399038:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787387969.399396:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8abf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399404:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8abf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399412:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8abf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399418:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387969.399423:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8abf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399430:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8abf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399455:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d436f2f6400) 00010000:00010000:1.0:1787387969.399458:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387969.399463:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8abf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399468:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8abf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399483:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399489:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399494:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399500:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387969.399503:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399508:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399515:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d4358720900) 00010000:00010000:1.0:1787387969.399517:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387969.399519:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ac6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.399524:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ac6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.400592:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8ab8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cd9 expref: 10 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.400613:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030000/0x93d41aeaa23c8acd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cd9 expref: 9 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.400622:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720700) 00010000:00010000:1.0:1787387969.400624:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387969.400627:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340030000, rc 0) 00000100:00100000:1.0:1787387969.400807:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+9:14388:x1874211690890240:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 5541us (5761us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787387969.400816:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:3.0:1787387969.407358:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387969.407556:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690890368 00000100:00100000:1.0:1787387969.407568:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690890368 00000100:00100000:1.0:1787387969.407635:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:1.0:1787387969.407646:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+9:14388:x1874211690890368:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787387969.409405:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+9:14388:x1874211690890368:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 1751us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387969.409420:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:3.0:1787387969.450716:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.451174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.451254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.451285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.451306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.451369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.451399:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690890624 00000100:00100000:3.0:1787387969.451409:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690890624 00000100:00100000:3.0:1787387969.451466:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690891136 00000100:00100000:3.0:1787387969.451470:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690891136 00000100:00100000:3.0:1787387969.451581:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690890752 00000100:00100000:3.0:1787387969.451584:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690890752 00000100:00100000:3.0:1787387969.451595:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690891008 00000100:00100000:3.0:1787387969.451597:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690891008 00000100:00100000:3.0:1787387969.451612:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1787387969.451621:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:396e9ca3-e412-469b-a169-aad215faf0ba+5:2350:x1874211690890624:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387969.451718:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:396e9ca3-e412-469b-a169-aad215faf0ba+5:2350:x1874211690890624:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 98us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387969.451726:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1787387969.451767:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1787387969.451774:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2350:x1874211690891136:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387969.451799:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2350:x1874211690891136:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387969.451806:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1787387969.451816:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1787387969.451821:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:396e9ca3-e412-469b-a169-aad215faf0ba+5:2351:x1874211690890752:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387969.451840:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:396e9ca3-e412-469b-a169-aad215faf0ba+5:2351:x1874211690890752:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 19us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387969.451848:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1787387969.451857:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:3.0:1787387969.451862:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2351:x1874211690891008:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387969.451881:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2351:x1874211690891008:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 19us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387969.451887:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00080000:1.0:1787387969.452058:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387969.452062:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387969.452395:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690890496 00000100:00100000:2.0:1787387969.452401:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690890496 00000100:00100000:2.0:1787387969.452451:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:2.0:1787387969.452459:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:2351:x1874211690890496:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1787387969.452521:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:2351:x1874211690890496:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 63us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387969.452529:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:0.0:1787387969.453728:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690890880 00000100:00100000:0.0:1787387969.453755:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690890880 00000100:00100000:0.0:1787387969.453867:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:0.0:1787387969.453877:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:2350:x1874211690890880:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387969.453946:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:2350:x1874211690890880:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 71us (2772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387969.453953:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00080000:1.0:1787387969.458811:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387969.463860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387969.468852:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690891264 00000100:00100000:1.0:1787387969.468932:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690891264 00000100:00100000:1.0:1787387969.469013:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1787387969.469026:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+9:14394:x1874211690891264:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1787387969.469075:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387969.469098:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8adb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52ce0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.470099:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ae2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.470623:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.470639:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.470660:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8ae9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.470668:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.470675:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471055:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471064:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ae2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471072:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471077:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387969.471090:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471099:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ae2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471664:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720600) 00010000:00010000:1.0:1787387969.471667:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387969.471672:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ae2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471678:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8ae2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471692:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471699:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471705:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471710:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387969.471713:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471718:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471724:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d4358720900) 00010000:00010000:1.0:1787387969.471726:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387969.471783:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8ae9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471790:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8ae9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471831:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8adb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ce0 expref: 10 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471841:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720600) 00010000:00010000:1.0:1787387969.471843:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387969.471847:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8adb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ce0 expref: 10 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.471855:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340031000, rc 0) 00000100:00100000:1.0:1787387969.472395:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+9:14394:x1874211690891264:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 3369us (8543us total) trans 0 rc 301/301 00000100:00100000:1.0:1787387969.472406:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:2.0:1787387969.480797:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387969.481185:0:14254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690891392 00000100:00100000:0.0:1787387969.481195:0:14254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690891392 00000100:00100000:0.0:1787387969.481252:0:14254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1787387969.481262:0:14254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:396e9ca3-e412-469b-a169-aad215faf0ba+9:14394:x1874211690891392:12345-192.168.204.59@tcp:700:lfs.0 00000100:00100000:0.0:1787387969.481345:0:14254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:396e9ca3-e412-469b-a169-aad215faf0ba+9:14394:x1874211690891392:12345-192.168.204.59@tcp:700:lfs.0 Request processed in 85us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387969.481353:0:14254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1787387969.485073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387969.485185:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690891648 00000100:00100000:0.0:1787387969.485201:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690891648 00000100:00100000:0.0:1787387969.485279:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:0.0:1787387969.485290:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+9:14394:x1874211690891648:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:0.0:1787387969.485357:0:16163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387969.485388:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8a1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52c5b expref: 9 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.485425:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720600) 00010000:00010000:0.0:1787387969.485430:0:16163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387969.485716:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.485731:0:16163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cbd expref: 5 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.485806:0:16163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.485843:0:16163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cbd expref: 5 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.485858:0:16163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cbd expref: 5 pid: 14246 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387969.485874:0:16163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4372011180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16163:1874211709757440:192.168.204.59@tcp:104: 00000100:00100000:0.0:1787387969.485993:0:16163:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4347ddae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387969.494176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.495362:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690891776 00000100:00100000:3.0:1787387969.495374:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690891776 00010000:00010000:3.0:1787387969.495418:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cbd expref: 6 pid: 14246 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387969.495492:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1787387969.495501:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:2350:x1874211690891776:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387969.495517:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387969.495524:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cbd expref: 6 pid: 14246 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.495548:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cbd expref: 6 pid: 14246 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.495573:0:14231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720600) 00010000:00010000:3.0:1787387969.495579:0:14231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.495589:0:14231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.495596:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.495615:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387969.495679:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:2350:x1874211690891776:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 179us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387969.495698:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00010000:00010000:0.0:1787387969.498358:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91200/0x93d41aeaa23c8a56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cbd expref: 5 pid: 14246 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387969.498388:0:16163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4372011180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16163:1874211709757440:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387969.498414:0:16163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.498424:0:16163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.498448:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.498487:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8af7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.498499:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.498509:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387969.501378:0:16163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787387969.501396:0:16163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.501407:0:16163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.501415:0:16163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.501421:0:16163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387969.501426:0:16163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.501434:0:16163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.501450:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720600) 00010000:00010000:0.0:1787387969.501454:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387969.501466:0:16163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.501613:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8af0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787387969.501635:0:16163:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061c838d8 reply state 0000000033dfa61b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387969.501645:0:16163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387969.502211:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+10:14394:x1874211690891648:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 16917us (17148us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787387969.502221:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00010000:00010000:0.0:1787387969.505330:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.505349:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8af7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.505357:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8af7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.505363:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387969.505370:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8af7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.505377:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8af7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.505396:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d4343c46000) 00010000:00010000:0.0:1787387969.505399:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387969.505404:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8af7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.505418:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8af7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387969.617465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387969.617643:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690891904 00000100:00100000:1.0:1787387969.617654:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690891904 00000100:00100000:1.0:1787387969.617726:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1787387969.617755:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+9:14402:x1874211690891904:12345-192.168.204.59@tcp:101:lctl.0 00010000:00010000:1.0:1787387969.617954:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387969.617981:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8afe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52ce7 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.618048:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031e00/0x93d41aeaa23c8b05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.618078:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031e00/0x93d41aeaa23c8b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.618091:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031e00/0x93d41aeaa23c8b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387969.618154:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787387969.618158:0:14245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787387969.618197:0:14245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031e00/0x93d41aeaa23c8b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.618220:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8afe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ce7 expref: 11 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.618238:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031e00/0x93d41aeaa23c8b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52ce7 expref: 10 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.618247:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720900) 00010000:00010000:1.0:1787387969.618250:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787387969.618253:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340031e00, rc 0) 00000100:00100000:1.0:1787387969.618361:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+10:14402:x1874211690891904:12345-192.168.204.59@tcp:101:lctl.0 Request processed in 627us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387969.618368:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1787387969.671215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.671458:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690892032 00000100:00100000:3.0:1787387969.671471:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690892032 00000100:00100000:3.0:1787387969.671552:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1787387969.671563:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:14403:x1874211690892032:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387969.671600:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387969.671627:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8b0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52cee expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.671702:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c8b13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.671718:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c8b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.671730:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c8b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387969.671946:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787387969.671951:0:14247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387969.671982:0:14247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c8b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.672010:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8b0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cee expref: 7 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.672031:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460be00/0x93d41aeaa23c8b13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cee expref: 6 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.672039:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720900) 00010000:00010000:3.0:1787387969.672043:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387969.672046:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d437460be00, rc 0) 00000100:00100000:3.0:1787387969.672115:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:14403:x1874211690892032:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 553us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387969.672123:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:2.0:1787387969.680466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.680628:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690892160 00000100:00100000:3.0:1787387969.680638:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690892160 00000100:00100000:3.0:1787387969.680697:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1787387969.680707:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:14403:x1874211690892160:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387969.680728:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387969.680772:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8b1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52cf5 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.680911:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8b21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.680926:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8b21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.680938:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8b21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.680951:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8b28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.680958:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.680965:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681146:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fc00/0x93d41aeaa23c8b2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681284:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fc00/0x93d41aeaa23c8b2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681303:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fc00/0x93d41aeaa23c8b2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387969.681347:0:14246:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787387969.681352:0:14246:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787387969.681376:0:14246:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fc00/0x93d41aeaa23c8b2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681390:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8b21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681396:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8b21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681404:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8b21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681410:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460ac00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387969.681415:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8b21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681423:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8b21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681435:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720900) 00010000:00010000:3.0:1787387969.681438:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387969.681443:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8b21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681449:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460ac00/0x93d41aeaa23c8b21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681473:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.681480:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8b28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.683310:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8b28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.683320:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d437460aa00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387969.683330:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8b28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.683339:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8b28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.683356:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d436f2d2600) 00010000:00010000:3.0:1787387969.683359:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787387969.683362:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8b28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.683369:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460aa00/0x93d41aeaa23c8b28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.683428:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d437460b400/0x93d41aeaa23c8b1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cf5 expref: 8 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.683442:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fc00/0x93d41aeaa23c8b2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cf5 expref: 7 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.683468:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d436f2d2f00) 00010000:00010000:3.0:1787387969.683471:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787387969.683474:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4375b5fc00, rc 0) 00000100:00100000:3.0:1787387969.683567:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+7:14403:x1874211690892160:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 2861us (3110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387969.683577:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:2.0:1787387969.698263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387969.698563:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690892416 00000100:00100000:0.0:1787387969.698575:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690892416 00000100:00100000:0.0:1787387969.698682:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1787387969.698693:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+7:14403:x1874211690892416:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1787387969.698714:0:16163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387969.698735:0:16163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8b36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52cfc expref: -99 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387969.698884:0:16163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787387969.699008:0:16163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8b36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cfc expref: 9 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.699023:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720900) 00010000:00010000:0.0:1787387969.699027:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787387969.699032:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8b36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cfc expref: 9 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.699046:0:16163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70400, rc 0) 00000100:00100000:0.0:1787387969.699110:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+8:14403:x1874211690892416:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 418us (855us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787387969.699117:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1787387969.702724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387969.702871:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690892672 00000100:00100000:1.0:1787387969.702881:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690892672 00000100:00100000:1.0:1787387969.702941:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:1.0:1787387969.702951:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+8:14403:x1874211690892672:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:1.0:1787387969.703036:0:14245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387969.703062:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fc00/0x93d41aeaa23c8b2f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52cf5 expref: 8 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.703086:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d436f2d2f00) 00010000:00010000:1.0:1787387969.703096:0:14245:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787387969.703120:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b44 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.703132:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.703142:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787387969.703523:0:14245:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001aa4ec0c reply state 000000004c7fb8af transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387969.703543:0:14245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787387969.703557:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787387969.703719:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+9:14403:x1874211690892672:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 768us (1004us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787387969.703731:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00010000:00010000:0.0:1787387969.708029:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.708062:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b44 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.708069:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b44 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.708075:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387969.708080:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b44 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.708088:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b44 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.708105:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d4358720b00) 00010000:00010000:0.0:1787387969.708108:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787387969.708113:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b44 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387969.708118:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b44 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387969.716600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.720181:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690892928 00000100:00100000:3.0:1787387969.720195:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690892928 00000100:00100000:2.0:1787387969.720475:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:2.0:1787387969.720487:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+8:14403:x1874211690892928:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1787387969.720789:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+9:14403:x1874211690892928:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 303us (4197us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787387969.720799:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:2.0:1787387969.728217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.728381:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690893184 00000100:00100000:3.0:1787387969.728392:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690893184 00000100:00100000:3.0:1787387969.728575:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:3.0:1787387969.728585:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+9:14403:x1874211690893184:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1787387969.728612:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387969.728632:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5f200/0x93d41aeaa23c8b4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d03 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.728708:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5e600/0x93d41aeaa23c8b52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.728723:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5e600/0x93d41aeaa23c8b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.728735:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5e600/0x93d41aeaa23c8b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.729762:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.729774:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.729783:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387969.730137:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787387969.730310:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5e600/0x93d41aeaa23c8b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730318:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5e600/0x93d41aeaa23c8b52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730343:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5e600/0x93d41aeaa23c8b52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730350:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4375b5e600 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387969.730354:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5e600/0x93d41aeaa23c8b52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730362:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5e600/0x93d41aeaa23c8b52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730374:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720900) 00010000:00010000:2.0:1787387969.730377:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387969.730382:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5e600/0x93d41aeaa23c8b52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730387:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5e600/0x93d41aeaa23c8b52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730403:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730408:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730415:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730420:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387969.730423:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730596:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730605:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d436f2f6e00) 00010000:00010000:2.0:1787387969.730607:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387969.730610:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730615:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730664:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5f200/0x93d41aeaa23c8b4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d03 expref: 11 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730675:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720900) 00010000:00010000:2.0:1787387969.730677:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787387969.730681:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5f200/0x93d41aeaa23c8b4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d03 expref: 11 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.730694:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4375b5f200, rc 0) 00000100:00100000:2.0:1787387969.730952:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+10:14403:x1874211690893184:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 2366us (2742us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787387969.730961:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:0.0:1787387969.735890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387969.736156:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690893312 00000100:00100000:1.0:1787387969.736171:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690893312 00000100:00100000:1.0:1787387969.736260:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:1.0:1787387969.736275:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+10:14403:x1874211690893312:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1787387969.736312:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387969.736346:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d0a expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.736848:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.736869:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.736885:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387969.736959:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787387969.736964:0:14245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787387969.737066:0:14245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.737106:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8b67 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d0a expref: 12 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.737128:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d0a expref: 11 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.737138:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d4358720500) 00010000:00010000:1.0:1787387969.737140:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787387969.737146:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340030a00, rc 0) 00000100:00100000:1.0:1787387969.737299:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+11:14403:x1874211690893312:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1026us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387969.737309:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:0.0:1787387969.747684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.747810:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690893440 00000100:00100000:3.0:1787387969.747825:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690893440 00000100:00100000:3.0:1787387969.747902:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:3.0:1787387969.747934:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+11:14403:x1874211690893440:12345-192.168.204.59@tcp:37:lfs.0 00000100:00100000:3.0:1787387969.755580:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+11:14403:x1874211690893440:12345-192.168.204.59@tcp:37:lfs.0 Request processed in 7629us (7891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387969.755601:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:0.0:1787387969.768137:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387969.768348:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690893696 00000100:00100000:2.0:1787387969.768362:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690893696 00000100:00100000:2.0:1787387969.768438:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1787387969.768451:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d438145b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+11:14403:x1874211690893696:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1787387969.768897:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d438145b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+12:14403:x1874211690893696:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 447us (773us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787387969.768906:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:0.0:1787387969.816964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387969.817082:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690893824 00000100:00100000:2.0:1787387969.817094:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690893824 00000100:00100000:2.0:1787387969.817173:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:2.0:1787387969.817184:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+10:14409:x1874211690893824:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1787387969.817206:0:16163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387969.817227:0:16163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d11 expref: -99 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.817500:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.817515:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.817527:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.817552:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.817559:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.817565:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.817672:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8b8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.817692:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8b8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.817699:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8b8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387969.817732:0:16163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787387969.817736:0:16163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787387969.818171:0:16163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8b8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818185:0:16163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818191:0:16163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818196:0:16163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818202:0:16163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387969.818205:0:16163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818212:0:16163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818224:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720900) 00010000:00010000:2.0:1787387969.818227:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387969.818232:0:16163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818248:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818262:0:16163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818268:0:16163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818274:0:16163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818279:0:16163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387969.818282:0:16163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818288:0:16163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818295:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d436f2f6e00) 00010000:00010000:2.0:1787387969.818297:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387969.818301:0:16163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818306:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818520:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d11 expref: 12 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818558:0:16163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90400/0x93d41aeaa23c8b8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d11 expref: 11 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.818565:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d4358720500) 00010000:00010000:2.0:1787387969.818568:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787387969.818571:0:16163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90400, rc 0) 00000100:00100000:2.0:1787387969.818703:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+11:14409:x1874211690893824:12345-192.168.204.59@tcp:101:bash.0 Request processed in 1521us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387969.818712:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:1.0:1787387969.837720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387969.839541:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690894080 00000100:00100000:2.0:1787387969.839555:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690894080 00000100:00100000:2.0:1787387969.839666:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:2.0:1787387969.839677:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+11:14409:x1874211690894080:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1787387969.839697:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387969.839727:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b91 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d18 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.840127:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.840143:0:14245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d0a expref: 11 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.840153:0:14245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.840188:0:14245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d0a expref: 11 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.840216:0:14245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d0a expref: 11 pid: 14245 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387969.840230:0:14245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14245:1874211709757568:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387969.840388:0:14245:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1787387969.844372:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387969.844453:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690894208 00000100:00100000:3.0:1787387969.844463:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690894208 00010000:00010000:3.0:1787387969.844502:0:14232:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d0a expref: 12 pid: 14245 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387969.844554:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1787387969.844563:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+12:2350:x1874211690894208:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387969.844578:0:14232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387969.844585:0:14232:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d0a expref: 12 pid: 14245 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.844598:0:14232:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d0a expref: 12 pid: 14245 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.844621:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d4358720500) 00010000:00010000:3.0:1787387969.844626:0:14232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.844636:0:14232:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.844643:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387969.844679:0:14232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387969.844772:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+12:2350:x1874211690894208:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 176us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387969.844781:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00010000:00010000:2.0:1787387969.845265:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8b6e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d0a expref: 11 pid: 14245 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387969.845286:0:14245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14245:1874211709757568:192.168.204.59@tcp:104: 00010000:00010000:2.0:1787387969.845307:0:14245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.845316:0:14245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.845321:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.845346:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b9f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.845356:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.845365:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.846473:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ba6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.846493:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.846503:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387969.846516:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787387969.846557:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.846565:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.846572:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.846578:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90c00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:2.0:1787387969.846582:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.846589:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.846601:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d4358720500) 00010000:00010000:2.0:1787387969.846604:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787387969.846608:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.846615:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8b98 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787387969.846626:0:14245:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061ba1b03 reply state 00000000394d3ce6 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387969.846642:0:14245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787387969.846678:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8b91 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d18 expref: 14 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.846693:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d18 expref: 13 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.846700:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:2.0:1787387969.846702:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787387969.846705:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91a00, rc 0) 00000100:00100000:2.0:1787387969.846804:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+14:14409:x1874211690894080:12345-192.168.204.59@tcp:101:bash.0 Request processed in 7128us (9094us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787387969.846813:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00010000:00010000:1.0:1787387969.849327:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.849358:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b9f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.849366:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.849373:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90200 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387969.849378:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.849385:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b9f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.849401:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d436f2f6e00) 00010000:00010000:1.0:1787387969.849404:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387969.849409:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b9f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.849416:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90200/0x93d41aeaa23c8b9f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387969.862637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387969.862961:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690894336 00000100:00100000:2.0:1787387969.862971:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690894336 00000100:00100000:2.0:1787387969.863045:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:2.0:1787387969.863055:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+13:14409:x1874211690894336:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1787387969.863078:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387969.863099:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8bb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d1f expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.863178:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.863192:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.863224:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387969.863266:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787387969.863270:0:14247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787387969.863287:0:14247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.863298:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.863322:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8bb4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d1f expref: 15 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.863340:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d1f expref: 14 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.863349:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:2.0:1787387969.863352:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787387969.863356:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f90c00, rc 0) 00000100:00100000:2.0:1787387969.863606:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+14:14409:x1874211690894336:12345-192.168.204.59@tcp:101:bash.0 Request processed in 551us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387969.863614:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:0.0:1787387969.867667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387969.867773:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690894592 00000100:00100000:2.0:1787387969.867783:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690894592 00000100:00100000:2.0:1787387969.867837:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1787387969.867846:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+14:14409:x1874211690894592:12345-192.168.204.59@tcp:35:bash.0 00000001:00080000:2.0:1787387969.868141:0:14248:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:2.0:1787387969.868278:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+16:14409:x1874211690894592:12345-192.168.204.59@tcp:35:bash.0 Request processed in 432us (619us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787387969.868285:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000020:00080000:2.0:1787387969.868290:0:14248:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787387969.956195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387969.956414:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690894848 00000100:00100000:1.0:1787387969.956426:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690894848 00000100:00100000:1.0:1787387969.956690:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:1.0:1787387969.956701:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+16:14419:x1874211690894848:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1787387969.956725:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387969.956781:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8bc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d26 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387969.956919:0:14246:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787387969.957056:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8bc2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d26 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.957071:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4358720900) 00010000:00010000:1.0:1787387969.957075:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787387969.957080:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8bc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d26 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387969.957095:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340031000, rc 0) 00000100:00100000:1.0:1787387969.957148:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+17:14419:x1874211690894848:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 449us (963us total) trans 8589934603 rc 301/301 00000100:00100000:1.0:1787387969.957157:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:3.0:1787387969.959709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387969.960368:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690895104 00000100:00100000:0.0:1787387969.960379:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690895104 00000100:00100000:0.0:1787387969.960452:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1787387969.960462:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+17:14419:x1874211690895104:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1787387969.960764:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+18:14419:x1874211690895104:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 302us (1064us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787387969.960772:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1787387969.997893:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387969.997993:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690895360 00000100:00100000:2.0:1787387969.998002:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690895360 00000100:00100000:2.0:1787387969.998054:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:2.0:1787387969.998063:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+18:14422:x1874211690895360:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1787387969.998087:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387969.998108:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8bd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d2d expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.998223:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91600/0x93d41aeaa23c8bd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.998236:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91600/0x93d41aeaa23c8bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.998247:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91600/0x93d41aeaa23c8bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387969.998263:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787387969.998371:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91e00/0x93d41aeaa23c8bd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d2d expref: 21 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.998388:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91600/0x93d41aeaa23c8bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d2d expref: 20 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387969.998396:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:2.0:1787387969.998411:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787387969.998415:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4242f91600, rc 0) 00000100:00100000:2.0:1787387969.998623:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+20:14422:x1874211690895360:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 559us (738us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787387969.998630:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:0.0:1787387970.004471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387970.004564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387970.004658:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690895616 00000100:00100000:1.0:1787387970.004669:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690895616 00000100:00100000:1.0:1787387970.004733:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:1.0:1787387970.004774:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:396e9ca3-e412-469b-a169-aad215faf0ba+20:2351:x1874211690895616:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787387970.004790:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387970.004814:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91600/0x93d41aeaa23c8bd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d2d expref: 20 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.004832:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:1.0:1787387970.004837:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387970.004883:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:396e9ca3-e412-469b-a169-aad215faf0ba+19:2351:x1874211690895616:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 113us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.004911:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:2.0:1787387970.009547:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690895488 00000100:00100000:2.0:1787387970.009563:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690895488 00000100:00100000:3.0:1787387970.009720:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:3.0:1787387970.009731:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+19:14422:x1874211690895488:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:3.0:1787387970.009815:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8be5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.009832:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8be5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.009844:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8be5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.009870:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8be5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.009878:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8be5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.009885:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8be5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.009891:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4375b5fa00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:3.0:1787387970.009895:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8be5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.009920:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8be5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.009933:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:3.0:1787387970.009936:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787387970.009940:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8be5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.009947:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8be5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387970.010121:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+19:14422:x1874211690895488:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 391us (5658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387970.010130:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:0.0:1787387970.012387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387970.012483:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690895872 00000100:00100000:2.0:1787387970.012494:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690895872 00000100:00100000:2.0:1787387970.012599:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1787387970.012611:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+19:14422:x1874211690895872:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1787387970.012846:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+20:14422:x1874211690895872:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 237us (467us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787387970.012854:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00010000:00010000:1.0:1787387970.013844:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787387970.270644:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787387970.282785:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387970.282876:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690896128 00000100:00100000:1.0:1787387970.282887:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690896128 00000100:00100000:1.0:1787387970.283012:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1787387970.283022:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+20:14453:x1874211690896128:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:1.0:1787387970.283049:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387970.283072:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8bec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d34 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.283198:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8bf3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.283212:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.283223:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387970.283234:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787387970.283391:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8bec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d34 expref: 23 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.283411:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d34 expref: 22 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.283420:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:1.0:1787387970.283436:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787387970.283441:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340030400, rc 0) 00000100:00100000:1.0:1787387970.283508:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+22:14453:x1874211690896128:12345-192.168.204.59@tcp:101:cat.0 Request processed in 487us (774us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787387970.283515:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:0.0:1787387970.287723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387970.288278:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690896256 00000100:00100000:3.0:1787387970.288289:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690896256 00000100:00100000:3.0:1787387970.288644:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:3.0:1787387970.288656:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:396e9ca3-e412-469b-a169-aad215faf0ba+22:2350:x1874211690896256:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387970.288672:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387970.288698:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8bf3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d34 expref: 22 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.288718:0:14231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:3.0:1787387970.288723:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387970.288824:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:396e9ca3-e412-469b-a169-aad215faf0ba+21:2350:x1874211690896256:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 171us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387970.288832:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1787387970.289559:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387970.289639:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690896512 00000100:00100000:3.0:1787387970.289646:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690896512 00000100:00100000:3.0:1787387970.289724:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1787387970.289733:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:396e9ca3-e412-469b-a169-aad215faf0ba+21:14453:x1874211690896512:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:3.0:1787387970.290437:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:396e9ca3-e412-469b-a169-aad215faf0ba+22:14453:x1874211690896512:12345-192.168.204.59@tcp:35:cat.0 Request processed in 703us (878us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787387970.290446:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:2.0:1787387970.357473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387970.357599:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690896768 00000100:00100000:1.0:1787387970.357609:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690896768 00000100:00100000:1.0:1787387970.357671:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:1.0:1787387970.357682:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+22:14459:x1874211690896768:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:1.0:1787387970.357707:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387970.357727:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c01 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d3b expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.357877:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8c08 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.357893:0:14246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ba6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d18 expref: 23 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.357901:0:14246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d1f expref: 23 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.357909:0:14246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8c08 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.357943:0:14246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d1f expref: 23 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.357956:0:14246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d1f expref: 23 pid: 14247 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387970.357986:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a080a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14246:1874211709757696:192.168.204.59@tcp:104: 00010000:00010000:1.0:1787387970.358076:0:14246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d18 expref: 23 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.358085:0:14246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d18 expref: 23 pid: 14245 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387970.358093:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a083480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14246:1874211709757824:192.168.204.59@tcp:104: 00000100:00100000:1.0:1787387970.358115:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387970.371625:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a080a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14246:1874211709757696:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387970.371647:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a083480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14246:1874211709757824:192.168.204.59@tcp:104: 00010000:00010000:3.0:1787387970.371680:0:14246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8c08 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387970.373324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387970.373444:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387970.373813:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690896896 00000100:00100000:3.0:1787387970.373822:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690896896 00010000:00010000:3.0:1787387970.373867:0:14232:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d1f expref: 24 pid: 14247 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387970.373900:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690897024 00000100:00100000:3.0:1787387970.373903:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690897024 00010000:00010000:3.0:1787387970.373916:0:14232:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d18 expref: 25 pid: 14245 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387970.373931:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:3.0:1787387970.373939:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437408c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396e9ca3-e412-469b-a169-aad215faf0ba+25:2351:x1874211690896896:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787387970.373952:0:14232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387970.373958:0:14232:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d1f expref: 25 pid: 14247 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.373991:0:14232:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d1f expref: 25 pid: 14247 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.374014:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8bbb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d1f expref: 25 pid: 14247 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.374030:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:3.0:1787387970.374035:0:14232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8c08 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.374043:0:14232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8c08 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.374049:0:14232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387970.374174:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437408c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:396e9ca3-e412-469b-a169-aad215faf0ba+24:2351:x1874211690896896:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 234us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387970.374182:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1787387970.374332:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:0.0:1787387970.374342:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:396e9ca3-e412-469b-a169-aad215faf0ba+23:2350:x1874211690897024:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387970.374351:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387970.374357:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d18 expref: 23 pid: 14245 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.374368:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d18 expref: 23 pid: 14245 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.374381:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ba6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d18 expref: 23 pid: 14245 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.374393:0:14231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:0.0:1787387970.374396:0:14231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8c08 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.374415:0:14231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8c08 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.374423:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8c08 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.374593:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387970.374617:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:396e9ca3-e412-469b-a169-aad215faf0ba+22:2350:x1874211690897024:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 275us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387970.374624:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00010000:00010000:3.0:1787387970.374694:0:14246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8c08 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.374702:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8c08 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787387970.374720:0:14246:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787387970.374926:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c01 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d3b expref: 23 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.374943:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030800/0x93d41aeaa23c8c08 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d3b expref: 22 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.374957:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:3.0:1787387970.374960:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787387970.374963:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340030800, rc 0) 00000100:00100000:3.0:1787387970.374988:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+22:14459:x1874211690896768:12345-192.168.204.59@tcp:101:dd.0 Request processed in 17308us (17527us total) trans 8589934609 rc 0/0 00000100:00100000:3.0:1787387970.374994:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:1.0:1787387970.379101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387970.379366:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690897280 00000100:00100000:0.0:1787387970.379377:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690897280 00000100:00100000:0.0:1787387970.379544:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:0.0:1787387970.379556:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+22:14459:x1874211690897280:12345-192.168.204.59@tcp:36:dd.0 00010000:00010000:0.0:1787387970.379954:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c16 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.379972:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.379985:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387970.380035:0:16163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:0.0:1787387970.380060:0:16163:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000502c2379 reply state 000000008dabf6be transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387970.380070:0:16163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387970.380174:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+25:14459:x1874211690897280:12345-192.168.204.59@tcp:36:dd.0 Request processed in 620us (1082us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1787387970.380192:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000020:00080000:0.0:1787387970.380197:0:16163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787387970.384463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387970.385367:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690897408 00000100:00100000:1.0:1787387970.385379:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690897408 00000100:00100000:1.0:1787387970.385444:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:1.0:1787387970.385454:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+25:14459:x1874211690897408:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:1.0:1787387970.385478:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387970.385500:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d42 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.385570:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d42 expref: 26 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.385586:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d42 expref: 26 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.385985:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.385996:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c16 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.386003:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.386010:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387970.386014:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.386022:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c16 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.386036:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:0.0:1787387970.386039:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387970.386044:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c16 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.386050:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c16 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.386135:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:1.0:1787387970.386392:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787387970.386395:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4340030e00, rc 0) 00000100:00100000:1.0:1787387970.386570:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+25:14459:x1874211690897408:12345-192.168.204.59@tcp:101:dd.0 Request processed in 1115us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.386579:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:2.0:1787387970.407144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387970.407577:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690897664 00000100:00100000:0.0:1787387970.407589:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690897664 00000100:00100000:0.0:1787387970.407659:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:0.0:1787387970.407670:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:396e9ca3-e412-469b-a169-aad215faf0ba+25:14459:x1874211690897664:12345-192.168.204.59@tcp:103:dd.0 00010000:00010000:0.0:1787387970.407703:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387970.407729:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d42 expref: 25 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.408568:0:14231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:0.0:1787387970.408574:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387970.408661:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:396e9ca3-e412-469b-a169-aad215faf0ba+24:14459:x1874211690897664:12345-192.168.204.59@tcp:103:dd.0 Request processed in 990us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387970.408669:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:0.0:1787387970.413653:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387970.414178:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690897792 00000100:00100000:1.0:1787387970.414189:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690897792 00000100:00100000:1.0:1787387970.414253:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:1.0:1787387970.414263:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+24:14459:x1874211690897792:12345-192.168.204.59@tcp:58:dd.0 00010000:00010000:1.0:1787387970.414358:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.414490:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387970.414503:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787387970.417462:0:14247:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387970.417640:0:14247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787387970.417711:0:14247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787387970.417863:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+24:14459:x1874211690897792:12345-192.168.204.59@tcp:58:dd.0 Request processed in 3597us (4216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.417875:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:2.0:1787387970.420934:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387970.421027:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690897920 00000100:00100000:3.0:1787387970.421039:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690897920 00000100:00100000:3.0:1787387970.421101:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1787387970.421112:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+24:14459:x1874211690897920:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:3.0:1787387970.421133:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387970.421152:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8c2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d49 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.421209:0:14246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.421219:0:14246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8c2b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d49 expref: 25 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.421420:0:14246:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.421438:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8c2b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d49 expref: 25 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.421469:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:3.0:1787387970.421472:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787387970.421477:0:14246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8c2b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d49 expref: 25 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387970.421485:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4375b5fa00, rc 0) 00000100:00100000:3.0:1787387970.421624:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+25:14459:x1874211690897920:12345-192.168.204.59@tcp:101:dd.0 Request processed in 513us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387970.421632:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00010000:00010000:1.0:1787387971.038280:0:16265:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787387971.294057:0:14277:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787387971.294068:0:14277:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787387971.294130:0:14277:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787387971.294138:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787387971.294272:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a081c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14277:1874211709757952:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787387971.294397:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4480 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.297618:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a081c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14277:1874211709757952:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787387971.301388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387971.301823:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690898048 00000100:00100000:3.0:1787387971.301834:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690898048 00000100:00100000:3.0:1787387971.301908:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1787387971.301920:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:396e9ca3-e412-469b-a169-aad215faf0ba+25:14461:x1874211690898048:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787387971.302005:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:396e9ca3-e412-469b-a169-aad215faf0ba+25:14461:x1874211690898048:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 Request processed in 88us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.302014:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00080000:1.0:1787387971.302203:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387971.310556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387971.316011:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690898176 00000100:00100000:0.0:1787387971.316026:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690898176 00000100:00100000:0.0:1787387971.316144:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:0.0:1787387971.316155:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+25:14461:x1874211690898176:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787387971.316188:0:16163:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787387971.316310:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+25:14461:x1874211690898176:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 157us (5765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.316319:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:0.0:1787387971.320853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387971.321144:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690898304 00000100:00100000:1.0:1787387971.321154:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690898304 00000100:00100000:1.0:1787387971.321254:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:1.0:1787387971.321265:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+25:14461:x1874211690898304:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787387971.321340:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8c32 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321359:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8c32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321372:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8c32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321454:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8c39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321462:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8c39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321470:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8c39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321510:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c40 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321519:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321544:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387971.321585:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787387971.321590:0:14245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787387971.321603:0:14245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321613:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8c32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321619:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8c32 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321625:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8c32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321631:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030400 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387971.321636:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8c32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321642:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8c32 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321654:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720700) 00010000:00010000:1.0:1787387971.321657:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387971.321661:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8c32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321667:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030400/0x93d41aeaa23c8c32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321700:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8c39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321707:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8c39 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321712:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8c39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321718:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387971.321721:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8c39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321727:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8c39 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321734:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d4358720100) 00010000:00010000:1.0:1787387971.321736:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387971.321758:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8c39 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321763:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030a00/0x93d41aeaa23c8c39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321776:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321782:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c40 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321787:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321797:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340030e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387971.321800:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321805:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c40 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321813:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:1.0:1787387971.321816:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387971.321819:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c40 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.321824:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340030e00/0x93d41aeaa23c8c40 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.321959:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+25:14461:x1874211690898304:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 694us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.321968:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:3.0:1787387971.324915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387971.325006:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690898560 00000100:00100000:1.0:1787387971.325018:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690898560 00000100:00100000:1.0:1787387971.325130:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:1.0:1787387971.325142:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+25:14461:x1874211690898560:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787387971.325167:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387971.325196:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c47 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d50 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325299:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325331:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325342:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787387971.325356:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787387971.325470:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325478:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c4e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325485:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325491:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387971.325496:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325515:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325529:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:1.0:1787387971.325532:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787387971.325536:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c4e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325543:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325582:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c47 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d50 expref: 27 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325598:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4358720700) 00010000:00010000:1.0:1787387971.325600:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787387971.325604:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c47 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d50 expref: 27 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.325613:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4e00, rc 0) 00000100:00100000:1.0:1787387971.325676:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+26:14461:x1874211690898560:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 536us (770us total) trans 8589934612 rc 301/301 00000100:00100000:1.0:1787387971.325684:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:2.0:1787387971.330920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387971.330994:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690898688 00000100:00100000:3.0:1787387971.331005:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690898688 00000100:00100000:3.0:1787387971.331088:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:3.0:1787387971.331098:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+26:14461:x1874211690898688:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787387971.331135:0:14246:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787387971.331237:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+26:14461:x1874211690898688:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 141us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.331259:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:2.0:1787387971.345637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387971.345733:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690898944 00000100:00100000:0.0:1787387971.345784:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690898944 00000100:00100000:0.0:1787387971.345833:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:0.0:1787387971.345841:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+26:14461:x1874211690898944:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787387971.345868:0:16163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387971.345889:0:16163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8c5c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d57 expref: -99 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787387971.346556:0:16163:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1787387971.346564:0:16163:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787387971.346610:0:16163:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787387971.346905:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c63 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.346920:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.346931:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.346981:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71a00/0x93d41aeaa23c8c5c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d57 expref: 29 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.346998:0:16163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d57 expref: 28 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.347007:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4343c46000) 00010000:00010000:0.0:1787387971.347010:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787387971.347013:0:16163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70000, rc 0) 00000100:00100000:0.0:1787387971.347070:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+28:14461:x1874211690898944:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1228us (1442us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787387971.347078:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1787387971.359181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387971.361981:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690899200 00000100:00100000:1.0:1787387971.361997:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690899200 00000100:00100000:1.0:1787387971.362073:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:1.0:1787387971.362085:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+28:14461:x1874211690899200:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787387971.362414:0:14245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387971.362444:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70000/0x93d41aeaa23c8c63 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d57 expref: 28 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362464:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4343c46000) 00010000:00010000:1.0:1787387971.362476:0:14245:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787387971.362514:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c71 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362529:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362539:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362607:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c78 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeb44c3f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362632:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb44c3f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362654:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb44c3f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362928:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362939:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c71 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362950:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c71 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362956:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387971.362964:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c71 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362975:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c71 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.362986:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d4358720500) 00010000:00010000:1.0:1787387971.362992:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387971.362996:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c71 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.363005:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4e00/0x93d41aeaa23c8c71 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.363031:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb44c3f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.363038:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c78 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb44c3f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.363051:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb44c3f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.363057:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387971.363060:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb44c3f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.363067:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c78 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb44c3f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.363076:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xeb44c3f9 (ffff8d4358720100) 00010000:00010000:1.0:1787387971.363078:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387971.363081:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c78 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeb44c3f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.363319:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c78 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeb44c3f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.363619:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+27:14461:x1874211690899200:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1534us (4446us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787387971.363629:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:2.0:1787387971.368971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387971.369351:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690899328 00000100:00100000:0.0:1787387971.369361:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690899328 00000100:00100000:0.0:1787387971.369459:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:0.0:1787387971.369470:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+27:14461:x1874211690899328:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787387971.369520:0:16163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387971.369547:0:16163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c7f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d5e expref: -99 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.369594:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8c86 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.369608:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8c86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.369620:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8c86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.369712:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c7f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d5e expref: 29 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.369730:0:16163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c70400/0x93d41aeaa23c8c86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d5e expref: 28 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.369784:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4343c46500) 00010000:00010000:0.0:1787387971.369787:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787387971.369791:0:16163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c70400, rc 0) 00000100:00100000:0.0:1787387971.369860:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+28:14461:x1874211690899328:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 390us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.369868:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:2.0:1787387971.372527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387971.378361:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690899584 00000100:00100000:1.0:1787387971.378376:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690899584 00000100:00100000:1.0:1787387971.378544:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:1.0:1787387971.378568:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+28:14461:x1874211690899584:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787387971.378688:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c8d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.378705:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.378717:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787387971.379339:0:14247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1787387971.379354:0:14247:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 475828614886ns, next at 476828612686ns, rc = 0 00000004:00010000:1.0:1787387971.379538:0:14247:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050dc1900 reply state 000000005b76054a transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.379550:0:14247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787387971.379682:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:396e9ca3-e412-469b-a169-aad215faf0ba+30:14461:x1874211690899584:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1115us (7165us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787387971.379691:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00010000:00010000:1.0:1787387971.381690:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.381708:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c8d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.381714:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c8d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.381721:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387971.381726:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c8d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.381771:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c8d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.381800:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4343c46500) 00010000:00010000:1.0:1787387971.381803:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787387971.381812:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c8d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.381818:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8c8d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387971.383937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387971.384033:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690899712 00000100:00100000:0.0:1787387971.384044:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690899712 00000100:00100000:0.0:1787387971.384101:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:0.0:1787387971.384111:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+29:14461:x1874211690899712:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787387971.384166:0:16163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387971.384188:0:16163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c94 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d65 expref: -99 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.384251:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d65 expref: 30 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.384265:0:16163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d65 expref: 30 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.384286:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4343c46500) 00010000:00010000:0.0:1787387971.384288:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787387971.384293:0:16163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71200, rc 0) 00000100:00100000:0.0:1787387971.384363:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+30:14461:x1874211690899712:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 253us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.384371:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:2.0:1787387971.387720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387971.387838:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690899840 00000100:00100000:3.0:1787387971.387851:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690899840 00000100:00100000:3.0:1787387971.387926:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1787387971.387937:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:396e9ca3-e412-469b-a169-aad215faf0ba+5:2351:x1874211690899840:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787387971.388370:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387971.388412:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:396e9ca3-e412-469b-a169-aad215faf0ba+6:2351:x1874211690899840:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 477us (700us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787387971.388420:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:2.0:1787387971.400231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387971.407725:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690900096 00000100:00100000:0.0:1787387971.407916:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690900096 00000100:00100000:0.0:1787387971.408124:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1787387971.408137:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+30:14461:x1874211690900096:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787387971.408390:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+31:14461:x1874211690900096:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 255us (8169us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787387971.408407:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:2.0:1787387971.414846:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387971.414987:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690900352 00000100:00100000:3.0:1787387971.414998:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690900352 00000100:00100000:3.0:1787387971.415057:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1787387971.415067:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+31:14461:x1874211690900352:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787387971.415186:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+31:14461:x1874211690900352:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 118us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.415195:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:2.0:1787387971.428482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387971.429228:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690900480 00000100:00100000:0.0:1787387971.429239:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690900480 00000100:00100000:0.0:1787387971.429302:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:0.0:1787387971.429312:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+31:14461:x1874211690900480:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787387971.429347:0:16163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387971.429370:0:16163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8c9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d6c expref: -99 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.429442:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c8ca2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.429456:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c8ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.429468:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c8ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787387971.429526:0:16163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787387971.429544:0:16163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c8ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.429572:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8c9b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d6c expref: 33 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.429587:0:16163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c8ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d6c expref: 32 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.429596:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4343c46500) 00010000:00010000:0.0:1787387971.429599:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787387971.429603:0:16163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4377c71600, rc 0) 00000100:00100000:0.0:1787387971.429668:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+32:14461:x1874211690900480:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 357us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.429676:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:2.0:1787387971.438784:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387971.438929:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690900608 00000100:00100000:1.0:1787387971.438940:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690900608 00000100:00100000:1.0:1787387971.439007:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:1.0:1787387971.439017:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:396e9ca3-e412-469b-a169-aad215faf0ba+6:2351:x1874211690900608:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787387971.439037:0:14879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387971.439060:0:14879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8ca9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d73 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787387971.439086:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a896043, blocks: 0x1 00010000:00010000:1.0:1787387971.439103:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787387971.439108:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387971.439117:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8ca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d73 expref: 7 pid: 14879 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.439134:0:14879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8ca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d73 expref: 7 pid: 14879 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.439164:0:14879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4342ad4800, rc 0) 00000100:00100000:1.0:1787387971.439227:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:396e9ca3-e412-469b-a169-aad215faf0ba+7:2351:x1874211690900608:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 211us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.439234:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1787387971.442564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387971.442638:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690900864 00000100:00100000:3.0:1787387971.442648:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690900864 00000100:00100000:3.0:1787387971.442704:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:3.0:1787387971.442713:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+32:14461:x1874211690900864:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787387971.442844:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+32:14461:x1874211690900864:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 132us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.442851:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:3.0:1787387971.449179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387971.449402:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690900992 00000100:00100000:2.0:1787387971.449412:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690900992 00000100:00100000:2.0:1787387971.449474:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:2.0:1787387971.449485:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+32:14461:x1874211690900992:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787387971.524729:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000001:00080000:3.0:1787387971.524782:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000004:00080000:3.0:1787387971.524806:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787387971.524825:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000100:00100000:3.0:1787387971.524956:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43584e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709758080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787387971.525036:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387971.525113:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709758080 00000100:00100000:3.0:1787387971.525120:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709758080 00000100:00100000:3.0:1787387971.525171:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787387971.525180:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874211709758080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787387971.525323:0:14880:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787387971.525326:0:14880:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787387971.525328:0:14880:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787387971.525330:0:14880:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787387971 -> 1787387971 00002000:00010000:3.0:1787387971.525333:0:14880:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787387971.525373:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874211709758080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (336us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787387971.525380:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787387971.525547:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787387971.525584:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d43584e0000/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787387971.525590:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43584e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874211709758080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787387971.525710:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:396e9ca3-e412-469b-a169-aad215faf0ba+21:14461:x1874211690900992:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 76225us (76538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.525718:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000001:00080000:1.0:1787387971.526020:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1787387971.530073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387971.530209:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690901120 00000100:00100000:1.0:1787387971.530219:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690901120 00000100:00100000:1.0:1787387971.530274:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:1.0:1787387971.530285:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:396e9ca3-e412-469b-a169-aad215faf0ba+7:2351:x1874211690901120:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787387971.530394:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:396e9ca3-e412-469b-a169-aad215faf0ba+7:2351:x1874211690901120:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 111us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.530412:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1787387971.533538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387971.533681:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690901376 00000100:00100000:0.0:1787387971.533690:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690901376 00000100:00100000:0.0:1787387971.533788:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1787387971.533798:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43584e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+14:14461:x1874211690901376:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787387971.533850:0:14246:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387971.533877:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71600/0x93d41aeaa23c8ca2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d6c expref: 14 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.533896:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4343c46500) 00010000:00010000:0.0:1787387971.533901:0:14246:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387971.533932:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8cb0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.533945:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.533966:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787387971.534422:0:14246:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a4e2e42 reply state 00000000825aa8c7 transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.534432:0:14246:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787387971.534582:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43584e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+15:14461:x1874211690901376:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 785us (1052us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1787387971.534590:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:2.0:1787387971.537843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387971.537919:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690901504 00000100:00100000:3.0:1787387971.537929:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690901504 00000100:00100000:3.0:1787387971.538006:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1787387971.538030:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:396e9ca3-e412-469b-a169-aad215faf0ba+7:14461:x1874211690901504:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787387971.538049:0:14880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387971.538066:0:14880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7ef3dec7b52d7a expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.538097:0:14880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8ca9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d73 expref: 8 pid: 14879 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.538106:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387971.538110:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387971.538116:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 8 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.538150:0:14880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8ca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d73 expref: 8 pid: 14879 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.538164:0:14880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8ca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d73 expref: 8 pid: 14879 timeout: 575 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387971.538178:0:14880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437ab46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14880:1874211709758208:192.168.204.59@tcp:104: 00000100:00100000:3.0:1787387971.538259:0:14880:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4341254900 going to sleep for 11 seconds 00010000:00010000:0.0:1787387971.540381:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.540397:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8cb0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.540418:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8cb0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.540424:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71e00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:0.0:1787387971.540429:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8cb0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.540436:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8cb0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.540454:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4343c46500) 00010000:00010000:0.0:1787387971.540457:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787387971.540462:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8cb0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.540469:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71e00/0x93d41aeaa23c8cb0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387971.544170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387971.544456:0:14880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437ab46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14880:1874211709758208:192.168.204.59@tcp:104: 00000100:00100000:1.0:1787387971.544522:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690901632 00000100:00100000:1.0:1787387971.544529:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690901632 00010000:00010000:3.0:1787387971.544546:0:14880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 8 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.544565:0:14230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8ca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d73 expref: 9 pid: 14879 timeout: 575 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.544597:0:14880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4375b5f600, rc 0) 00000100:00100000:1.0:1787387971.544622:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:1.0:1787387971.544631:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43747cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:396e9ca3-e412-469b-a169-aad215faf0ba+9:2351:x1874211690901632:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787387971.544645:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387971.544666:0:14230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8ca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d73 expref: 9 pid: 14879 timeout: 575 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.544679:0:14230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8ca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d73 expref: 9 pid: 14879 timeout: 575 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.544709:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8ca9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d73 expref: 9 pid: 14879 timeout: 575 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.544724:0:14230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387971.544728:0:14230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387971.544736:0:14230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 8 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.544777:0:14230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 8 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.544812:0:14230:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 8 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.544825:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a081c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14230:1874211709758336:192.168.204.59@tcp:105: 00000100:00100000:3.0:1787387971.545180:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:396e9ca3-e412-469b-a169-aad215faf0ba+8:14461:x1874211690901504:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 7150us (7344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.545190:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:1.0:1787387971.545760:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.551677:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a081c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14230:1874211709758336:192.168.204.59@tcp:105: 00010000:00010000:1.0:1787387971.551707:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387971.551784:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43747cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:396e9ca3-e412-469b-a169-aad215faf0ba+7:2351:x1874211690901632:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 7152us (7622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.551794:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1787387971.553600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387971.556015:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690901760 00000100:00100000:1.0:1787387971.556029:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690901760 00000100:00100000:1.0:1787387971.556158:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:1.0:1787387971.556183:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:396e9ca3-e412-469b-a169-aad215faf0ba+7:2350:x1874211690901760:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787387971.556371:0:14879:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787387971.556376:0:14879:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787387970 00002000:00010000:1.0:1787387971.556378:0:14879:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787387969 00002000:00010000:1.0:1787387971.556380:0:14879:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787387971 -> 1787387970 00002000:00010000:1.0:1787387971.556382:0:14879:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787387971.556460:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:396e9ca3-e412-469b-a169-aad215faf0ba+8:2350:x1874211690901760:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 278us (2863us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787387971.556468:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:2.0:1787387971.563867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387971.564125:0:15604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690901888 00000100:00100000:1.0:1787387971.564137:0:15604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690901888 00000100:00100000:1.0:1787387971.564197:0:15604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:1.0:1787387971.564207:0:15604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:396e9ca3-e412-469b-a169-aad215faf0ba+8:2351:x1874211690901888:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787387971.564253:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.564274:0:15604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 8 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.564283:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787387971.564287:0:15604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787387971.564291:0:15604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.564327:0:15604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 8 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.564360:0:15604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 8 pid: 14880 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.564376:0:15604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a081c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15604:1874211709758464:192.168.204.59@tcp:104: 00000100:00100000:1.0:1787387971.564520:0:15604:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387971.573346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387971.573716:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690902016 00000100:00100000:0.0:1787387971.573725:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690902016 00000100:00100000:1.0:1787387971.573761:0:15604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a081c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15604:1874211709758464:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387971.573787:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 9 pid: 14880 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.573790:0:15604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.573826:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:0.0:1787387971.573836:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437ab46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:396e9ca3-e412-469b-a169-aad215faf0ba+9:2350:x1874211690902016:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787387971.573856:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387971.573878:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 9 pid: 14880 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.573906:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 9 pid: 14880 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.573933:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037b55d82/0x93d41aeaa23c8cb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d7a expref: 9 pid: 14880 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.574008:0:14231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787387971.574013:0:14231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787387971.574020:0:14231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.574029:0:14231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.574104:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387971.574206:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437ab46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:396e9ca3-e412-469b-a169-aad215faf0ba+8:2350:x1874211690902016:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 370us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.574218:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00010000:00010000:1.0:1787387971.574279:0:15604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.574290:0:15604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.574313:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.574322:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.574329:0:15604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.574347:0:15604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4800 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387971.574352:0:15604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.574360:0:15604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.574372:0:15604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.574380:0:15604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9566259/0x93d41aeaa23c8cbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.574426:0:15604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:396e9ca3-e412-469b-a169-aad215faf0ba+7:2351:x1874211690901888:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 10220us (10569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.574434:0:15604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1787387971.576826:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387971.576907:0:16163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690902272 00000100:00100000:2.0:1787387971.576916:0:16163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690902272 00000100:00100000:2.0:1787387971.576986:0:16163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:2.0:1787387971.576996:0:16163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+14:14461:x1874211690902272:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787387971.577075:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8cc5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.577093:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.577107:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.577376:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.577393:0:16163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c94 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d65 expref: 15 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.577412:0:16163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.577445:0:16163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d65 expref: 15 pid: 16163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.577459:0:16163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c94 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d65 expref: 15 pid: 16163 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387971.577473:0:16163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16163:1874211709758592:192.168.204.59@tcp:104: 00000100:00100000:2.0:1787387971.577560:0:16163:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4374276f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387971.581604:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387971.581694:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690902400 00000100:00100000:1.0:1787387971.581704:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690902400 00010000:00010000:1.0:1787387971.581779:0:14230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c94 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d65 expref: 16 pid: 16163 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.581812:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:1.0:1787387971.581821:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:396e9ca3-e412-469b-a169-aad215faf0ba+16:2350:x1874211690902400:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787387971.581836:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387971.581855:0:14230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c94 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d65 expref: 16 pid: 16163 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.581868:0:14230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c94 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d65 expref: 16 pid: 16163 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.581891:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4343c46500) 00010000:00010000:1.0:1787387971.581896:0:14230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.581905:0:14230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.581912:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.581930:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387971.581981:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:396e9ca3-e412-469b-a169-aad215faf0ba+16:2350:x1874211690902400:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 161us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387971.581990:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00010000:00010000:0.0:1787387971.582292:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4377c71200/0x93d41aeaa23c8c94 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d65 expref: 15 pid: 16163 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.582307:0:16163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16163:1874211709758592:192.168.204.59@tcp:104: 00010000:00010000:0.0:1787387971.582326:0:16163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.582341:0:16163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.582346:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387971.582547:0:16163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787387971.582695:0:16163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:0.0:1787387971.582835:0:16163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787387971.582920:0:16163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4372010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16163:1874211709758720:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787387971.583026:0:16163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387971.583057:0:16163:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4342f19480 going to sleep for 11 seconds 00000100:00100000:3.0:1787387971.583132:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709758720 00000100:00100000:3.0:1787387971.583137:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709758720 00000100:00100000:3.0:1787387971.583183:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387971.583191:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4372011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16163:x1874211709758720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787387971.583273:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16163:x1874211709758720:12345-0@lo:1000:mdt00_003.0 Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.583281:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387971.583416:0:16163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4372010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16163:1874211709758720:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787387971.584033:0:16163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:1.0:1787387971.584096:0:16163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a081c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16163:1874211709758848:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787387971.584132:0:16163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387971.584149:0:16163:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387971.584344:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709758848 00000100:00100000:0.0:1787387971.584350:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709758848 00000100:00100000:0.0:1787387971.584374:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387971.584381:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16163:x1874211709758848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787387971.584534:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16163:x1874211709758848:12345-0@lo:1000:mdt00_003.0 Request processed in 152us (400us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787387971.584541:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387971.584763:0:16163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a081c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16163:1874211709758848:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787387971.584798:0:16163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584822:0:16163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584829:0:16163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584835:0:16163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91a00 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387971.584839:0:16163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584846:0:16163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584862:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4343c46500) 00010000:00010000:1.0:1787387971.584865:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787387971.584869:0:16163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584876:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f91a00/0x93d41aeaa23c8ccc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584908:0:16163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584914:0:16163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584919:0:16163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584923:0:16163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4340031000 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387971.584931:0:16163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584937:0:16163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584945:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:1.0:1787387971.584948:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787387971.584954:0:16163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8c2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d49 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584964:0:16163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8c2b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d49 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.584972:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8c2b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d49 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.585026:0:16163:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4375b5fa00/0x93d41aeaa23c8c2b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4b7ef3dec7b52d49 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.585040:0:16163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a080700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16163:1874211709758976:192.168.204.59@tcp:105: 00000100:00100000:1.0:1787387971.585107:0:16163:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4350af4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787387971.588261:0:16163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a080700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16163:1874211709758976:192.168.204.59@tcp:105: 00010000:00010000:1.0:1787387971.588295:0:16163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588306:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4340031000/0x93d41aeaa23c8c24 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588357:0:16163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8cd3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588370:0:16163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8cd3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588385:0:16163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8cd3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588406:0:16163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8cd3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588413:0:16163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8cd3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588419:0:16163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8cd3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588424:0:16163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad4800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387971.588427:0:16163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8cd3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588434:0:16163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8cd3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588446:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:1.0:1787387971.588449:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787387971.588453:0:16163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8cd3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588458:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4342ad4800/0x93d41aeaa23c8cd3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588475:0:16163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588481:0:16163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8cc5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588486:0:16163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588491:0:16163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90800 already unused, calling callback (ffffffffc1fa44f0) 00010000:00010000:1.0:1787387971.588504:0:16163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588510:0:16163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8cc5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588518:0:16163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d436f2f6300) 00010000:00010000:1.0:1787387971.588520:0:16163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787387971.588523:0:16163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8cc5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387971.588528:0:16163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90800/0x93d41aeaa23c8cc5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387971.588779:0:16163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4372013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:396e9ca3-e412-469b-a169-aad215faf0ba+18:14461:x1874211690902272:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 11782us (11958us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1787387971.588788:0:16163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000020:00080000:1.0:1787387971.588794:0:16163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787387971.589469:0:14277:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787387971.589476:0:14277:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787387971.589515:0:14277:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787387971.589520:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787387971.592185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387971.593342:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690902656 00000100:00100000:3.0:1787387971.593355:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690902656 00000100:00100000:3.0:1787387971.594087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387971.594182:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690902784 00000100:00100000:0.0:1787387971.594188:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690902784 00000100:00100000:0.0:1787387971.594229:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:0.0:1787387971.594238:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+19:14459:x1874211690902784:12345-192.168.204.59@tcp:49:dd.0 00000100:00100000:0.0:1787387971.594390:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:396e9ca3-e412-469b-a169-aad215faf0ba+19:14459:x1874211690902784:12345-192.168.204.59@tcp:49:dd.0 Request processed in 152us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.594612:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:2.0:1787387971.596820:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1787387971.596833:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4381459050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:396e9ca3-e412-469b-a169-aad215faf0ba+18:14461:x1874211690902656:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787387971.597514:0:14249:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787387971.597621:0:14249:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:2.0:1787387971.597661:0:14249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8cda lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.597677:0:14249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8cda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.597690:0:14249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8cda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.597709:0:14249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8cda lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.597716:0:14249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8cda lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.597722:0:14249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8cda lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.597773:0:14249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787387971.597869:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4381459050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:396e9ca3-e412-469b-a169-aad215faf0ba+20:14461:x1874211690902656:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 1037us (5692us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787387971.597878:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000020:00080000:2.0:1787387971.597883:0:14249:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787387971.598824:0:14234:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387971.598835:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8cda lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.598845:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90c00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387971.598849:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8cda lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.598858:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8cda lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.598873:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4343c46500) 00010000:00010000:3.0:1787387971.598884:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787387971.598890:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8cda lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.598897:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4242f90c00/0x93d41aeaa23c8cda lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.598911:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387971.598913:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387971.598914:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387971.753513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387971.753560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387971.753807:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690903040 00000100:00100000:0.0:1787387971.753817:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690903040 00000100:00100000:0.0:1787387971.753877:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690902912 00000100:00100000:0.0:1787387971.753881:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690902912 00000100:00100000:0.0:1787387971.753900:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1787387971.753909:0:14886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:396e9ca3-e412-469b-a169-aad215faf0ba+8:2352:x1874211690903040:12345-192.168.204.59@tcp:4:dd.0 00002000:00010000:0.0:1787387971.753959:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a896042, atime: 0x6a896041, ctime: 0x6a896042, blocks: 0x1 00010000:00010000:0.0:1787387971.753968:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007697d4de/0x93d41aeaa23c8ce1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.753982:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787387971.753986:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387971.753991:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007697d4de/0x93d41aeaa23c8ce1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.754004:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007697d4de/0x93d41aeaa23c8ce1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387971.757317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387971.757411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387971.757824:0:14885:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787387971.757834:0:14885:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787387971.757900:0:14887:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787387971.757916:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690903296 00000100:00100000:0.0:1787387971.757924:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690903296 00000100:00100000:0.0:1787387971.757971:0:14887:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787387971.757978:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690903168 00000100:00100000:0.0:1787387971.757981:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690903168 00000100:00100000:2.0:1787387971.759796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387971.759838:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1787387971.760780:0:14885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690903552 00000100:00100000:2.0:1787387971.760791:0:14885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690903552 00000100:00100000:2.0:1787387971.760848:0:14885:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787387971.760858:0:14885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690903424 00000100:00100000:2.0:1787387971.760861:0:14885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690903424 00000100:00100000:0.0:1787387971.761376:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:1.0:1787387971.761959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1787387971.762037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1787387971.762604:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:396e9ca3-e412-469b-a169-aad215faf0ba+13:2352:x1874211690902912:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:0.0:1787387971.762671:0:16378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c8ce8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.762691:0:16378:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387971.762695:0:16378:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387971.762702:0:16378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c8ce8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.762718:0:16378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c8ce8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387971.764336:0:14887:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787387971.764349:0:14887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1787387971.764375:0:14885:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787387971.764383:0:14885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690903680 00000100:00100000:3.0:1787387971.764393:0:14885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690903680 00000100:00100000:3.0:1787387971.764435:0:14885:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787387971.764440:0:14885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690903808 00000100:00100000:3.0:1787387971.764443:0:14885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690903808 00000100:00100000:3.0:1787387971.766910:0:16379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:3.0:1787387971.766930:0:16379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:396e9ca3-e412-469b-a169-aad215faf0ba+16:2352:x1874211690903296:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:3.0:1787387971.766976:0:16379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d05ac4c4/0x93d41aeaa23c8cef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.766996:0:16379:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387971.767000:0:16379:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787387971.767006:0:16379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d05ac4c4/0x93d41aeaa23c8cef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387971.767031:0:16379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d05ac4c4/0x93d41aeaa23c8cef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787387971.931836:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:1.0:1787387971.931872:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1787387971.931894:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1787387971.932165:0:14886:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1787387971.932171:0:14886:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787387970 -> 1787387971 00002000:00010000:0.0:1787387971.932174:0:14886:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787387970 -> 1787387971 00002000:00010000:0.0:1787387971.932176:0:14886:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:0.0:1787387971.932194:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007697d4de/0x93d41aeaa23c8ce1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.932210:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007697d4de/0x93d41aeaa23c8ce1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.932221:0:14886:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007697d4de/0x93d41aeaa23c8ce1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.932229:0:14886:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c71200 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:0.0:1787387971.932235:0:14886:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007697d4de/0x93d41aeaa23c8ce1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.932261:0:14886:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007697d4de/0x93d41aeaa23c8ce1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.932288:0:14886:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007697d4de/0x93d41aeaa23c8ce1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.932296:0:14886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007697d4de/0x93d41aeaa23c8ce1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387971.932415:0:14886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:396e9ca3-e412-469b-a169-aad215faf0ba+16:2352:x1874211690903040:12345-192.168.204.59@tcp:4:dd.0 Request processed in 178499us (178904us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787387971.932428:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1787387971.932470:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:0.0:1787387971.932485:0:14886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:396e9ca3-e412-469b-a169-aad215faf0ba+15:2352:x1874211690903168:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:2.0:1787387971.932539:0:16378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c8ce8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.932542:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8cf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.932549:0:16378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c8ce8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.932557:0:16378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c8ce8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.935259:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387971.935273:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787387971.935285:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387971.935311:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.937674:0:16378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70200 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387971.937694:0:16378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c8ce8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.937718:0:16378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c8ce8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.937761:0:16378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c8ce8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.937772:0:16378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000061bf896/0x93d41aeaa23c8ce8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387971.937893:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:396e9ca3-e412-469b-a169-aad215faf0ba+14:2352:x1874211690902912:12345-192.168.204.59@tcp:4:dd.0 Request processed in 176495us (184325us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787387971.937906:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:2.0:1787387971.937951:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1787387971.937965:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:396e9ca3-e412-469b-a169-aad215faf0ba+14:2352:x1874211690903552:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:2.0:1787387971.938010:0:16378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018fb03ac/0x93d41aeaa23c8cfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.938024:0:16378:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387971.938028:0:16378:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387971.938037:0:16378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018fb03ac/0x93d41aeaa23c8cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387971.938068:0:16378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018fb03ac/0x93d41aeaa23c8cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387972.023085:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1787387972.023543:0:16379:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:2.0:1787387972.023549:0:16379:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1787387972.023567:0:16379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d05ac4c4/0x93d41aeaa23c8cef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.023584:0:16379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d05ac4c4/0x93d41aeaa23c8cef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.023594:0:16379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d05ac4c4/0x93d41aeaa23c8cef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.023602:0:16379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4375b5f000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387972.023608:0:16379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d05ac4c4/0x93d41aeaa23c8cef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.023619:0:16379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d05ac4c4/0x93d41aeaa23c8cef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.023647:0:16379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d05ac4c4/0x93d41aeaa23c8cef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.023655:0:16379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d05ac4c4/0x93d41aeaa23c8cef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387972.023835:0:16379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:396e9ca3-e412-469b-a169-aad215faf0ba+16:2352:x1874211690903296:12345-192.168.204.59@tcp:4:dd.0 Request processed in 256903us (266517us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787387972.023848:0:16379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:2.0:1787387972.023888:0:16379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1787387972.023902:0:16379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d43746a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:396e9ca3-e412-469b-a169-aad215faf0ba+15:2352:x1874211690903424:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:2.0:1787387972.023944:0:16379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c8d04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.023958:0:16379:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387972.023963:0:16379:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387972.023971:0:16379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c8d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.023983:0:16379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c8d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.064706:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787387972.070961:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:2.0:1787387972.071526:0:14886:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:2.0:1787387972.071549:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.071564:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8cf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.071574:0:14886:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8cf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.071598:0:14886:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4377c70c00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387972.071604:0:14886:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8cf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.071614:0:14886:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8cf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.071639:0:14886:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8cf6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.071646:0:14886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aea45e0/0x93d41aeaa23c8cf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387972.071789:0:14886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:396e9ca3-e412-469b-a169-aad215faf0ba+13:2352:x1874211690903168:12345-192.168.204.59@tcp:4:dd.0 Request processed in 139302us (314370us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787387972.071801:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:2.0:1787387972.071840:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:2.0:1787387972.071854:0:14886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:396e9ca3-e412-469b-a169-aad215faf0ba+12:2353:x1874211690903680:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:2.0:1787387972.071897:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029c99635/0x93d41aeaa23c8d0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.071911:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387972.071916:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787387972.071924:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029c99635/0x93d41aeaa23c8d0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.071950:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029c99635/0x93d41aeaa23c8d0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.072185:0:16378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018fb03ac/0x93d41aeaa23c8cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.072195:0:16378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018fb03ac/0x93d41aeaa23c8cfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.072203:0:16378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018fb03ac/0x93d41aeaa23c8cfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.072209:0:16378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f90c00 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:1.0:1787387972.072213:0:16378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018fb03ac/0x93d41aeaa23c8cfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.072220:0:16378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018fb03ac/0x93d41aeaa23c8cfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.072231:0:16378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018fb03ac/0x93d41aeaa23c8cfd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.072239:0:16378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018fb03ac/0x93d41aeaa23c8cfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387972.072283:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:396e9ca3-e412-469b-a169-aad215faf0ba+12:2352:x1874211690903552:12345-192.168.204.59@tcp:4:dd.0 Request processed in 134321us (312493us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787387972.072295:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1787387972.072322:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1787387972.072330:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:396e9ca3-e412-469b-a169-aad215faf0ba+11:2352:x1874211690903808:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:1.0:1787387972.072351:0:16378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004efd1bde/0x93d41aeaa23c8d12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.072360:0:16378:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387972.072364:0:16378:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787387972.072368:0:16378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004efd1bde/0x93d41aeaa23c8d12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.072378:0:16378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004efd1bde/0x93d41aeaa23c8d12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787387972.118428:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1787387972.118696:0:16379:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:3.0:1787387972.118702:0:16379:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1787387972.118721:0:16379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c8d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.118754:0:16379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c8d04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.118766:0:16379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c8d04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.118774:0:16379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91000 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387972.118780:0:16379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c8d04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.118791:0:16379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c8d04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.118819:0:16379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c8d04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.118827:0:16379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000727e04af/0x93d41aeaa23c8d04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387972.118974:0:16379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d43746a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:396e9ca3-e412-469b-a169-aad215faf0ba+13:2352:x1874211690903424:12345-192.168.204.59@tcp:4:dd.0 Request processed in 95070us (359127us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787387972.118986:0:16379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000001:00080000:0.0:1787387972.188074:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:0.0:1787387972.188110:0:6629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:2.0:1787387972.188205:0:14886:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1787387972.188229:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029c99635/0x93d41aeaa23c8d0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.188246:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029c99635/0x93d41aeaa23c8d0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.188255:0:14886:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029c99635/0x93d41aeaa23c8d0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.188262:0:14886:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4242f91600 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:2.0:1787387972.188268:0:14886:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029c99635/0x93d41aeaa23c8d0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.188277:0:14886:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029c99635/0x93d41aeaa23c8d0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.188302:0:14886:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029c99635/0x93d41aeaa23c8d0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.188311:0:14886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029c99635/0x93d41aeaa23c8d0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387972.188840:0:14886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:396e9ca3-e412-469b-a169-aad215faf0ba+7:2353:x1874211690903680:12345-192.168.204.59@tcp:4:dd.0 Request processed in 116981us (426872us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787387972.188854:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00010000:00010000:3.0:1787387972.189361:0:16378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004efd1bde/0x93d41aeaa23c8d12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.189375:0:16378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004efd1bde/0x93d41aeaa23c8d12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.189444:0:16378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004efd1bde/0x93d41aeaa23c8d12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.189452:0:16378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4342ad5800 already unused, calling callback (ffffffffc1568e90) 00010000:00010000:3.0:1787387972.189456:0:16378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004efd1bde/0x93d41aeaa23c8d12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.189465:0:16378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004efd1bde/0x93d41aeaa23c8d12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.189489:0:16378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004efd1bde/0x93d41aeaa23c8d12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.189499:0:16378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004efd1bde/0x93d41aeaa23c8d12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387972.189592:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:396e9ca3-e412-469b-a169-aad215faf0ba+5:2352:x1874211690903808:12345-192.168.204.59@tcp:4:dd.0 Request processed in 117259us (427551us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787387972.189602:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00010000:00010000:1.0:1787387973.085878:0:16265:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787387973.920216:0:16420:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1787387974.114893:0:14234:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387974.238222:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709759104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387974.238303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387974.238433:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709759104 00000100:00100000:3.0:1787387974.238450:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709759104 00000100:00100000:3.0:1787387974.238515:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787387974.238525:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709759104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787387974.238558:0:14884:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787387974.238601:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709759104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387974.238609:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787387974.239000:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787387974.239039:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709759104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387974.239371:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387974.239383:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d43746a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709759232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387974.239417:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387974.239652:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709759488:0@lo:400:kworker.0 00000100:00100000:3.0:1787387974.239683:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387974.239701:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387974.239706:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3312:1874211709759360:0@lo:400:kworker.0 00000100:00100000:3.0:1787387974.239758:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387974.239787:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709759616:0@lo:400:kworker.0 00000100:00100000:3.0:1787387974.239810:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387974.239825:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387974.239831:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709759744:0@lo:400:kworker.0 00000100:00100000:3.0:1787387974.239860:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387974.239901:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709759488 00000100:00100000:3.0:1787387974.239906:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709759488 00000100:00100000:3.0:1787387974.239937:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709759616 00000100:00100000:3.0:1787387974.239941:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709759616 00000100:00100000:3.0:1787387974.239959:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709759744 00000100:00100000:1.0:1787387974.240158:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787387974.240169:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709759488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387974.240217:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874211709759488:12345-0@lo:400:kworker.0 Request processed in 52us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387974.240224:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787387974.240250:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787387974.240256:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709759616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387974.240294:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874211709759616:12345-0@lo:400:kworker.0 Request processed in 37us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387974.240300:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787387974.240319:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709759360 00000100:00100000:1.0:1787387974.240323:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709759360 00000100:00100000:1.0:1787387974.240349:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787387974.240356:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3312:x1874211709759360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387974.240385:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:498227b4-d0f5-4d95-bb91-ab0eaf258c1d+19:3312:x1874211709759360:12345-0@lo:400:kworker.0 Request processed in 29us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387974.240391:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1787387974.240426:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387974.240461:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:498227b4-d0f5-4d95-bb91-ab0eaf258c1d:3312:1874211709759360:0@lo:400:kworker.0 00000100:00100000:1.0:1787387974.240475:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874211709759488:0@lo:400:kworker.0 00000100:00100000:1.0:1787387974.240506:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874211709759616:0@lo:400:kworker.0 00000100:00100000:2.0:1787387974.241097:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211709759232 00000100:00100000:2.0:1787387974.241104:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709759232 00000100:00100000:2.0:1787387974.241155:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787387974.241164:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709759232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387974.241192:0:14884:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1787387974.241240:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874211709759232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387974.241247:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787387974.241527:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387974.241555:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1787387974.241562:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d43584e0000, transno 8589934595 00000004:00080000:1.0:1787387974.241578:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1787387974.241600:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d43746a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874211709759232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787387974.241649:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211709759744 00000100:00080000:1.0:1787387974.241731:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387974.241799:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787387974.241807:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709759744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387974.241852:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874211709759744:12345-0@lo:400:kworker.0 Request processed in 47us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387974.241859:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787387974.241911:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d437a749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874211709759744:0@lo:400:kworker.0 00000100:00100000:3.0:1787387974.573204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387974.573251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387974.573287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387974.573322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387974.573592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387974.573618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387974.573644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1787387974.573670:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690904192 00000100:00100000:3.0:1787387974.573679:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690904192 00000100:00100000:3.0:1787387974.573730:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690904704 00000100:00100000:3.0:1787387974.573733:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690904704 00000100:00100000:3.0:1787387974.573792:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690904320 00000100:00100000:3.0:1787387974.573795:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690904320 00000100:00100000:3.0:1787387974.573806:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690904576 00000100:00100000:3.0:1787387974.573809:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690904576 00000100:00100000:3.0:1787387974.573823:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:3.0:1787387974.573832:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:396e9ca3-e412-469b-a169-aad215faf0ba+5:2353:x1874211690904192:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387974.573901:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:396e9ca3-e412-469b-a169-aad215faf0ba+5:2353:x1874211690904192:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 69us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387974.573925:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:3.0:1787387974.573942:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1787387974.573948:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2353:x1874211690904704:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387974.573976:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2353:x1874211690904704:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387974.573983:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1787387974.573999:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1787387974.574005:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:396e9ca3-e412-469b-a169-aad215faf0ba+5:2353:x1874211690904320:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387974.574029:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:396e9ca3-e412-469b-a169-aad215faf0ba+5:2353:x1874211690904320:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387974.574034:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1787387974.574044:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:3.0:1787387974.574049:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2353:x1874211690904576:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1787387974.574069:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+5:2353:x1874211690904576:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 19us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387974.574075:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00080000:3.0:1787387974.574093:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787387974.574097:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387974.574714:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690903936 00000100:00100000:1.0:1787387974.574720:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690903936 00000100:00100000:1.0:1787387974.574789:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:1.0:1787387974.574797:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d437a725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:2353:x1874211690903936:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1787387974.574829:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d437a725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12f74adc-05ae-4131-a2a8-f9c8cd73affb+13:2353:x1874211690903936:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 33us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387974.574836:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:0.0:1787387974.575601:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690904448 00000100:00100000:0.0:1787387974.575610:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690904448 00000100:00100000:0.0:1787387974.575671:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211690904064 00000100:00100000:0.0:1787387974.575674:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211690904064 00000100:00100000:0.0:1787387974.575696:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:0.0:1787387974.575703:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:2353:x1874211690904448:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387974.575771:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e21cb2fe-2288-41c3-ab30-f8ea608ab52c+6:2353:x1874211690904448:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 68us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.575777:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:0.0:1787387974.575790:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:0.0:1787387974.575795:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4345014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+20:2353:x1874211690904064:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1787387974.575818:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4345014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:396e9ca3-e412-469b-a169-aad215faf0ba+20:2353:x1874211690904064:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (2472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.575823:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00080000:3.0:1787387974.576326:0:14241:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787387974.689040:0:14277:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787387974.689049:0:14277:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787387974.689082:0:14277:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787387974.689088:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787387975.135309:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29731 lines, 29731 kept, 0 dropped, 0 bad.